-- Logs begin at Thu 2022-09-22 13:46:39 UTC, end at Thu 2022-09-22 14:57:26 UTC. -- Sep 22 14:18:57.418219 dv-cinder-855359-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 22 14:18:57.425619 dv-cinder-855359-4-smb devstack@keystone.service[81538]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 14:18:57 2022] *** Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: nodename: dv-cinder-855359-4-smb Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: machine: x86_64 Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: clock source: unix Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: pcre jit disabled Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: detected number of CPU cores: 4 Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: current working directory: / Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: detected binary path: /usr/bin/uwsgi-core Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: your processes number limit is 47680 Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: your memory page size is 4096 bytes Sep 22 14:18:57.428728 dv-cinder-855359-4-smb devstack@keystone.service[81538]: detected max file descriptor number: 2048 Sep 22 14:18:57.429447 dv-cinder-855359-4-smb devstack@keystone.service[81538]: lock engine: pthread robust mutexes Sep 22 14:18:57.429447 dv-cinder-855359-4-smb devstack@keystone.service[81538]: thunder lock: enabled Sep 22 14:18:57.429447 dv-cinder-855359-4-smb devstack@keystone.service[81538]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 22 14:18:57.429447 dv-cinder-855359-4-smb devstack@keystone.service[81538]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 14:18:57.468581 dv-cinder-855359-4-smb devstack@keystone.service[81538]: Python main interpreter initialized at 0x55d51248f9c0 Sep 22 14:18:57.468581 dv-cinder-855359-4-smb devstack@keystone.service[81538]: python threads support enabled Sep 22 14:18:57.468581 dv-cinder-855359-4-smb devstack@keystone.service[81538]: your server socket listen backlog is limited to 100 connections Sep 22 14:18:57.468581 dv-cinder-855359-4-smb devstack@keystone.service[81538]: your mercy for graceful operations on workers is 90 seconds Sep 22 14:18:57.468954 dv-cinder-855359-4-smb devstack@keystone.service[81538]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 14:18:57.469032 dv-cinder-855359-4-smb devstack@keystone.service[81538]: *** Operational MODE: preforking *** Sep 22 14:18:57.469276 dv-cinder-855359-4-smb devstack@keystone.service[81538]: *** uWSGI is running in multiple interpreter mode *** Sep 22 14:18:57.469276 dv-cinder-855359-4-smb devstack@keystone.service[81538]: spawned uWSGI master process (pid: 81538) Sep 22 14:18:57.469485 dv-cinder-855359-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 22 14:18:57.471290 dv-cinder-855359-4-smb devstack@keystone.service[81538]: spawned uWSGI worker 1 (pid: 81549, cores: 1) Sep 22 14:18:57.471290 dv-cinder-855359-4-smb devstack@keystone.service[81538]: spawned uWSGI worker 2 (pid: 81550, cores: 1) Sep 22 14:18:57.471290 dv-cinder-855359-4-smb devstack@keystone.service[81538]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 14:19:01.875051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:19:01.875051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: from cryptography.utils import int_from_bytes Sep 22 14:19:01.875866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:19:01.875866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: from cryptography.utils import int_from_bytes Sep 22 14:19:01.877665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:19:01.877665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: from cryptography.utils import int_from_bytes Sep 22 14:19:01.878140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 14:19:01.878140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: from cryptography.utils import int_from_bytes Sep 22 14:19:01.926591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 14:19:01.926780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 14:19:01.926965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] command line args: [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 14:19:01.927237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 14:19:01.927418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ================================================================================ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 14:19:01.927670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] admin_token = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.927935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] config_dir = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.928121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.928289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] config_source = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.928472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] debug = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.928605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 14:19:01.928692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.928919 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 14:19:01.928984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] command line args: [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 14:19:01.929042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.929204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.929291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 14:19:01.929423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ================================================================================ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 14:19:01.929546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.929679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] admin_token = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.929784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.929911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] config_dir = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_config_append = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] config_source = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_dir = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] debug = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_file = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.930951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931501 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.931973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_config_append = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_dir = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_file = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.932999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.933141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.933218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.933389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.933470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.933594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.933706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.933786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.933970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.934085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.934238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.934475 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.934554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.934675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] publish_errors = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.934764 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.934876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.934954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.935989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] standard_threads = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.936210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.936407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.936487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.936578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] publish_errors = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.936664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.936783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_journal = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.936865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.936962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_json = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.937039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.937139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_stderr = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.937224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.937320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] use_syslog = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.937432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.937551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.937668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.937807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.937892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] standard_threads = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.938072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.938164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.938334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.938412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.938556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.938632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.938736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_journal = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.938814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.938917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_json = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.939036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.939193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_stderr = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.939267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_syslog = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.939335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.939478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 14:19:01.939556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.939736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.939822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.939977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.940055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.940225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.940343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.940459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.940548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.940704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.940781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.941485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.941575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.941769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.942042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.942272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.942350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.942527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.942605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.942780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.942870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.943027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.943108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.943264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.943340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.943510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.943587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.943763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.943841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.944948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.945033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.945183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.945262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.945431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.945509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.945678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.945758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.945914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.946983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.947137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.947221 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.947372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.947449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.947608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.947690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.947841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.947918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.948072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.948149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.948304 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.948381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.948536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.948619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.948764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.948848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.949948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.950984 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.951109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.951299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.951385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.951503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.951591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.951708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.951823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.951899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.952932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.953964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.954148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.954240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.954387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.954473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.954658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.954738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.954897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.954984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.955147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.955226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.955392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.955474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.955627 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.955716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.955869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.955954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.956104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.956189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.956344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.956429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.956607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.956677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.956848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.957174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.957301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.957459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.957583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.957662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.957829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.957912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.958107 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.958200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.958358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.958438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.958595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.958674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.958832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.958924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.959072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.959150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.959324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.959402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.959563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.959640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.959803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.959881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.960986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.961067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.961216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.961294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.961448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.961526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.961677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.961755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.961912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.962971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.963129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.963207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.963367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.963446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.963606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.963692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.963844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.963923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.964076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.external = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.964155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.964307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.964384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.964540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.964619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.964778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.964858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.password = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] auth.token = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.965971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.966066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.966227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.966308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.966475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.966557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.966720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.966800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.966952 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.967032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.external = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.967185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.967274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.967429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.967507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.967678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.967763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.967926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.password = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.token = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.968959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.969117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.969204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.969357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.969439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.969602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.969680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.969839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.969926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.970101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.970185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.970352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.970432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.970603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.970695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.970854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.970933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.971089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.971167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.971326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.971481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.971557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.971629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.971803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.971889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.972033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.972190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.972328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.972547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.972846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.972927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.973113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.973209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.973369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.973449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.973607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.973687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.973855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.973943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.974118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.974198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.974366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.974446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.974613 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.974710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.974849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.974930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.975084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.975164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.975332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.975418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.975566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.975644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.975802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.975881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.976977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.977056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.977222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.977301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.977486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.977574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.977713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.977792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.977963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.978094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.978227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.978319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.978469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.978549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.978721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.978799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.978955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.979972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.980388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.980468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.980625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.980712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.980873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.980953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.981104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.981182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.981352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.981432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.981599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.981679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.981835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.981914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.982106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.982189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.982353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.982433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.982584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.982669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.982819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.982898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983133 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.983998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.984077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.984236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.984317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.984470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.984548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.984722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.984826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.984975 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.985055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.985214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.985293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.985465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.985544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.985715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.985796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.985950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.986093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.986216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.986295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.986450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.986531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.986687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.986765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.986925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.987002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.987169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.987250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.987406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.987484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.987642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.988274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.988563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.988679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.988852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.989095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.989245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.989369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.989502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.989626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.989749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.989878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.990032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.990158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.990296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.990427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.990554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.990700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.990821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.990949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.991099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.991228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.991355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.991483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.991610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.991737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.991872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.992000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.992128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.992254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.992380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.992508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.992642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.992818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.992943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.993067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.993191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.993315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.993446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.993571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.993695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.993819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.993942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.994139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.994262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.994636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.994774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.994911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.995038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.995174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.995302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.995429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.995556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.995685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.995811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.995946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.996073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.996200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.996327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.996452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.996578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.996789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.996916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.997044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.997171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.997297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.997423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.997557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.997684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.997812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.997939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.998080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.998080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.998331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.998470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.998598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.998726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.998854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.998982 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.999116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.999251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.999378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.999511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.999639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.999767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] role.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:01.999903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.000031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] role.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.000158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.000295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.000422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.000550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.000680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.000803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.000933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.001056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.001179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.001301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.001435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.001558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.001682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.001806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.001938 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.002076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.002213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.002342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.002469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.002596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.002722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.002850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.002994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.003120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.003247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.003446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.004065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.004184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.004369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.004369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] role.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.004734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.004862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] role.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.004990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.005118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.005259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.005387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.005514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.005642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.005769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.005896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.006052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.006052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.006052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.006407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.006537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.006670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.006794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.006794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.007025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.007149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.007272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.007403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.007532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.007661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.007788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.007926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.008974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.009210 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.009335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.009458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.009590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.009723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.009847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.010003 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.010129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.010257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.010385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.010521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.010677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.010803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.010927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.011062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.011188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.011333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.011462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.011588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.011714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.011841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.011968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.012102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.012228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.012353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.012481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.012607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.012734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.012869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.012995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.013139 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.013273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.013399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.013526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.013652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.013786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.013913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.014057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.014186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.014313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.014441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.014576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.014701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.014825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.014961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.015084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.015216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.015346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.015474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.015598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.015721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.015844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.015968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.016098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.016227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.016355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.016482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.016615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.016743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.016879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.017009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.017137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.017260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.017388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.017516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.017647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.017771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.017894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.018770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 14:19:02.020949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 14:19:02.044965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.045208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.045434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.046187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.046428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.046661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.054649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.056153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.083555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.083782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.085681 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.085920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.138211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.139730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.188636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.188873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.189644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.189888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.349762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.350014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.350244 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.350469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.350692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.350912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.351208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.351449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.351680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.351928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.352221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.352457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.375366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.375625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.375782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.375925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.376076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.376211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.376346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.376478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.376641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.376775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.376854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.376929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.377003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.377003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.388705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.389142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.402180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.402416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.402628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.402715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.402858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.402940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.403081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.403172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.403300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.403385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.403516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.403600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.403731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.403950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 22 14:19:02.420590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.420803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 14:19:02.421091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.421175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.421307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 14:19:02.421392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 14:19:02.421601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.421683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.421848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 22 14:19:02.421930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.422151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.422236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.422418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.422500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.422682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.422950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.432288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.432574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.432852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.433142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.433224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.433428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.433706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.434012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.440247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.442118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.443747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.444036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.444327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.444616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.444906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.445060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.445184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.445351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.445433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.445640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.445723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.445929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.446026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.446244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.446325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.446513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.446606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.446791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.447072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.447347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.447625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.447897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.469714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.471229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.471520 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.471695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.473668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.473954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.476273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.476561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.476848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.478689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.478982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.479275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.483507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.483798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.485912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.486229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.489503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.489803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.490126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.490422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.490708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.490994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.491274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.491553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.492442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.492745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.493042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.493338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.493628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.493911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.494214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.494492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.507746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.508032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.511095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.511385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.511861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.515074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.515268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.515389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.518546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.518857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.520268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.523546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.524095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.526807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.527113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.527258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.527403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.527691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.527979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.528276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.530478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.530786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.531076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.531366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.531651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.531937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.544288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.544581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.544855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.545125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.548093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.548388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.548661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.548936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.552056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.553610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.555174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.555458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.556242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.557760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.558188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.558478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.558775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.559064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.559308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.559455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.559592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.562221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.562524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.562816 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.563101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.563508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.571160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.571446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.571730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.572014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.572399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.572694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.572983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.575744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.576038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.576329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.576630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.577018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.577305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.577604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.588951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.591898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.594159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.594841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.596337 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.597115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.597970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.598286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.598685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.600475 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.602068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.603552 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.603843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.604255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.605315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.606817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.609724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.610153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.610447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.610730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.610964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.612449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.616418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.616825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.617120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.617405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.619300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.619596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.619896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.625286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.625586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.625878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.626831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.627116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.627401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.627685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.627981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.628258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.629116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.629406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.629684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.629960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.630268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.630561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.630896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.631172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.633810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 22 14:19:02.634124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.634414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.634698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.634980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.635267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.635546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.635826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.636123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.636401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.636685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.636952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.637224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.637497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 22 14:19:02.665417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d51248f9c0 pid: 81550 (default app) Sep 22 14:19:02.668714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58cbf3-7e5a-4fea-9bf5-07e266f0a62a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:02.669007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58cbf3-7e5a-4fea-9bf5-07e266f0a62a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:02.669281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58cbf3-7e5a-4fea-9bf5-07e266f0a62a None None] PATH_INFO: `/v3` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:02.672824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d51248f9c0 pid: 81549 (default app) Sep 22 14:19:02.673392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Sep 22 14:19:02 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:10.364295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc105-e2ff-40b8-b488-64491b0f480e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:10.364797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc105-e2ff-40b8-b488-64491b0f480e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:10.364906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc105-e2ff-40b8-b488-64491b0f480e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:10.369099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:10.374724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:10.375164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:10.375258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:10.447215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: INFO dbcounter [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] Registered counter for database keystone Sep 22 14:19:10.468383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG oslo_db.sqlalchemy.engines [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:19:10.475537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writer thread running {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:19:10.653629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG passlib.handlers.bcrypt [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81550) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 14:19:10.653949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG passlib.handlers.bcrypt [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81550) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 14:19:10.714086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:10.715722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:10.843846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 22 14:19:11.354277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc105-e2ff-40b8-b488-64491b0f480e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:11.424520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: INFO dbcounter [None req-584cc105-e2ff-40b8-b488-64491b0f480e None None] Registered counter for database keystone Sep 22 14:19:11.444553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG oslo_db.sqlalchemy.engines [None req-584cc105-e2ff-40b8-b488-64491b0f480e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 14:19:11.450954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writer thread running {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 14:19:11.570060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc105-e2ff-40b8-b488-64491b0f480e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:11.574207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b9af8-3c58-4792-a3d8-4f44809fca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:11.574857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9af8-3c58-4792-a3d8-4f44809fca9e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:11.575135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9af8-3c58-4792-a3d8-4f44809fca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:11.575405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b9af8-3c58-4792-a3d8-4f44809fca9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:11.584166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b9af8-3c58-4792-a3d8-4f44809fca9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:11.637592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4e6b9af8-3c58-4792-a3d8-4f44809fca9e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 14:19:11.637925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b9af8-3c58-4792-a3d8-4f44809fca9e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:11.647230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Sep 22 14:19:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 14:19:11.653145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:11.670161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56bad1-29a4-4edf-9096-2e162f0e89cd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:11.674558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752ebac-10fb-4795-a08b-78ceb9ca86c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:11.676342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ebac-10fb-4795-a08b-78ceb9ca86c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:11.676628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ebac-10fb-4795-a08b-78ceb9ca86c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:11.676909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ebac-10fb-4795-a08b-78ceb9ca86c9 admin admin] PATH_INFO: `/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:11.678497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752ebac-10fb-4795-a08b-78ceb9ca86c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3670bb30aaf4bc3a00e3f65e0110ae7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:11.732839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9752ebac-10fb-4795-a08b-78ceb9ca86c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 22 14:19:11.733180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752ebac-10fb-4795-a08b-78ceb9ca86c9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:11.738171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Sep 22 14:19:11 2022] GET /identity/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:13.944947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baae40-ed2a-4855-b684-e7e4e363ce3f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:13.945462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baae40-ed2a-4855-b684-e7e4e363ce3f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:13.945564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baae40-ed2a-4855-b684-e7e4e363ce3f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:13.949622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:13.955114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a92c-95b9-4770-ab3d-a806a579c4bf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:13.955494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a92c-95b9-4770-ab3d-a806a579c4bf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:13.955670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a92c-95b9-4770-ab3d-a806a579c4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:13.975759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c138a92c-95b9-4770-ab3d-a806a579c4bf None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:13.977277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c138a92c-95b9-4770-ab3d-a806a579c4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:13.985365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 22 14:19:14.264948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baae40-ed2a-4855-b684-e7e4e363ce3f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:14.278318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baae40-ed2a-4855-b684-e7e4e363ce3f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:14.282510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef44d6-1b19-43f1-a755-4bd56c185dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:14.283111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef44d6-1b19-43f1-a755-4bd56c185dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:14.283395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef44d6-1b19-43f1-a755-4bd56c185dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:14.283672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef44d6-1b19-43f1-a755-4bd56c185dc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:14.291793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef44d6-1b19-43f1-a755-4bd56c185dc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:14.293563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef44d6-1b19-43f1-a755-4bd56c185dc6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:14.302730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Sep 22 14:19:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:19:14.307932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138a92c-95b9-4770-ab3d-a806a579c4bf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:14.317487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138a92c-95b9-4770-ab3d-a806a579c4bf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:14.321841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0249530-dbcd-4e5b-9c44-23aafa12d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:14.322504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0249530-dbcd-4e5b-9c44-23aafa12d87b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:14.322785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0249530-dbcd-4e5b-9c44-23aafa12d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:14.323059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0249530-dbcd-4e5b-9c44-23aafa12d87b admin admin] PATH_INFO: `/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:14.324364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0249530-dbcd-4e5b-9c44-23aafa12d87b admin admin] RBAC: Authorizing `identity:get_user(user_id=83e7a3ec09bb47549d2dc9a48d9658cb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:14.326212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0249530-dbcd-4e5b-9c44-23aafa12d87b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:14.327724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Sep 22 14:19:14 2022] GET /identity/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:16.542313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b793b4-fe22-457e-bea0-c7471def4404 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:16.542832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b793b4-fe22-457e-bea0-c7471def4404 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:16.542832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b793b4-fe22-457e-bea0-c7471def4404 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:16.544117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:16.550654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b4f2-398d-409e-bc86-c5d5743d93a5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:16.551156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b4f2-398d-409e-bc86-c5d5743d93a5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:16.551248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b4f2-398d-409e-bc86-c5d5743d93a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:16.569484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c886b4f2-398d-409e-bc86-c5d5743d93a5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:16.570722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c886b4f2-398d-409e-bc86-c5d5743d93a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:16.646164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ac9c-fbb9-4c46-baa9-2388776613c3 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:16.646443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ac9c-fbb9-4c46-baa9-2388776613c3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:16.646710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ac9c-fbb9-4c46-baa9-2388776613c3 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:16.648026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:16.653017 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:16.653203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:16.653457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:16.653728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:16.696181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG passlib.handlers.bcrypt [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81549) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 22 14:19:16.696572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG passlib.handlers.bcrypt [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81549) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 22 14:19:16.746086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:16.747621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:16.844985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:19:16.921541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886b4f2-398d-409e-bc86-c5d5743d93a5 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:16.946769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:17.028039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886b4f2-398d-409e-bc86-c5d5743d93a5 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:17.061150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b63d-4973-412e-a99c-5b663c3478f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:17.061787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b63d-4973-412e-a99c-5b663c3478f2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:17.062107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b63d-4973-412e-a99c-5b663c3478f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:17.062386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103b63d-4973-412e-a99c-5b663c3478f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:17.073802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103b63d-4973-412e-a99c-5b663c3478f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-8103b63d-4973-412e-a99c-5b663c3478f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:17.082640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:17.083703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:17.084619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:19:17.089565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:17.116513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b63d-4973-412e-a99c-5b663c3478f2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:17.189900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a0e1-4bc1-441a-8b2f-f3187daa8e03 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:17.192830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:17.198282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:17.215994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103b63d-4973-412e-a99c-5b663c3478f2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:17.227745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:17.228615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:17.228895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:17.229167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:17.230287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:17.230627 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:17.232135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:17.245309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:17.250982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:17.253400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cdd08-9379-4152-9311-c5e5b4e82905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:17.254213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cdd08-9379-4152-9311-c5e5b4e82905 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:17.254494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cdd08-9379-4152-9311-c5e5b4e82905 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:17.255580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cdd08-9379-4152-9311-c5e5b4e82905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:17.324018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cdd08-9379-4152-9311-c5e5b4e82905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:17.325495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cdd08-9379-4152-9311-c5e5b4e82905 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:17.354470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca423-be3a-41e3-986e-54c6615008ac None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:17.388454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911b776-1d71-480f-8576-3fa059ba295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:17.389228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911b776-1d71-480f-8576-3fa059ba295b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:17.389517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911b776-1d71-480f-8576-3fa059ba295b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:17.389794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911b776-1d71-480f-8576-3fa059ba295b None admin] PATH_INFO: `/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:17.391312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911b776-1d71-480f-8576-3fa059ba295b None admin] RBAC: Authorizing `identity:get_user(user_id=83e7a3ec09bb47549d2dc9a48d9658cb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:17.392761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911b776-1d71-480f-8576-3fa059ba295b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:17.394890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:17 2022] GET /identity/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:17.400221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911b776-1d71-480f-8576-3fa059ba295b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:17.405543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:17.423224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 14:19:17.428796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cdd08-9379-4152-9311-c5e5b4e82905 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:17.434549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:17.500546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911b776-1d71-480f-8576-3fa059ba295b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:17.527418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cdd08-9379-4152-9311-c5e5b4e82905 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:17.534349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe81f6-0091-43f3-92d2-d5c9e0c09ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:17.534982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe81f6-0091-43f3-92d2-d5c9e0c09ceb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:17.535261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe81f6-0091-43f3-92d2-d5c9e0c09ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:17.535532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe81f6-0091-43f3-92d2-d5c9e0c09ceb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:17.536666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe81f6-0091-43f3-92d2-d5c9e0c09ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:17.538148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe81f6-0091-43f3-92d2-d5c9e0c09ceb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:17.539690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:17.545329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe81f6-0091-43f3-92d2-d5c9e0c09ceb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:17.560714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:17.561352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:17.561634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:17.561907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:17.573535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:17.575062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:19:17.592720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:17.593718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:19:17.594638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:19:17.594638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:19:17.594638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:17.594638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:19:17.600067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:17.635061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:17.646572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe81f6-0091-43f3-92d2-d5c9e0c09ceb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:17.648130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:17.680345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fad2a-30b2-4de7-97dc-e8c7907edbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:17.680954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fad2a-30b2-4de7-97dc-e8c7907edbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:17.681235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fad2a-30b2-4de7-97dc-e8c7907edbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:17.681505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fad2a-30b2-4de7-97dc-e8c7907edbb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:17.682271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fad2a-30b2-4de7-97dc-e8c7907edbb4 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.domain.id=default, user.id=83e7a3ec09bb47549d2dc9a48d9658cb) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:17.682609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fad2a-30b2-4de7-97dc-e8c7907edbb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:17.684025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fad2a-30b2-4de7-97dc-e8c7907edbb4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:17.692736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Sep 22 14:19:17 2022] GET /identity/v3/role_assignments?user.id=83e7a3ec09bb47549d2dc9a48d9658cb&scope.domain.id=default&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:17.704709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac8c44-27fe-4b7f-9c23-84dc0062a224 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:17.742947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b655e-bc9a-4ecd-ad6d-daa52c4c7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:17.743578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b655e-bc9a-4ecd-ad6d-daa52c4c7544 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:17.743856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b655e-bc9a-4ecd-ad6d-daa52c4c7544 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:17.744127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b655e-bc9a-4ecd-ad6d-daa52c4c7544 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:17.744793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b655e-bc9a-4ecd-ad6d-daa52c4c7544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:17.745098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b655e-bc9a-4ecd-ad6d-daa52c4c7544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:17.746579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b655e-bc9a-4ecd-ad6d-daa52c4c7544 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:17.765384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:20.220386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec61b-deed-47e7-9fa6-ebb90aed2f4e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:20.220929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec61b-deed-47e7-9fa6-ebb90aed2f4e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:20.220929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec61b-deed-47e7-9fa6-ebb90aed2f4e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:20.223276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:20.231621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90de4a-f19f-4df5-927b-145d890785e0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:20.232078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90de4a-f19f-4df5-927b-145d890785e0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:20.232152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90de4a-f19f-4df5-927b-145d890785e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:20.259187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1d90de4a-f19f-4df5-927b-145d890785e0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:20.260390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1d90de4a-f19f-4df5-927b-145d890785e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:20.356440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:20.717384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389490-4145-45db-8c58-35fba6979e41 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:20.717779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389490-4145-45db-8c58-35fba6979e41 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:20.717965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389490-4145-45db-8c58-35fba6979e41 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:20.719451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:20.725668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7e98-f9a3-4af5-9378-46865786d01a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:20.725965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7e98-f9a3-4af5-9378-46865786d01a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:20.726274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb7e98-f9a3-4af5-9378-46865786d01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:20.734677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c78f2-4446-4eae-a573-11d0c9f326cf None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:20.735251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c78f2-4446-4eae-a573-11d0c9f326cf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:20.735747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c78f2-4446-4eae-a573-11d0c9f326cf None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:20.737300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 14/25] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:20.742537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0270a-8bef-48f9-9814-1f5a6c19d6a5 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:20.743061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0270a-8bef-48f9-9814-1f5a6c19d6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:20.743536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0270a-8bef-48f9-9814-1f5a6c19d6a5 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:20.744995 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 15/26] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:20.746247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8c340-f7ec-4e21-b1d2-5dad99d72cc0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:20.746731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8c340-f7ec-4e21-b1d2-5dad99d72cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:20.747236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8c340-f7ec-4e21-b1d2-5dad99d72cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:20.771342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-70bb7e98-f9a3-4af5-9378-46865786d01a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:20.773993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-70bb7e98-f9a3-4af5-9378-46865786d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:20.780889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d5b8c340-f7ec-4e21-b1d2-5dad99d72cc0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:20.782334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d5b8c340-f7ec-4e21-b1d2-5dad99d72cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:20.811145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:20.874264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 12/27] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:20.875738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f90511-1fb3-43f7-a431-9b3f5f5febaa None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:20.876165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f90511-1fb3-43f7-a431-9b3f5f5febaa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:20.876578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f90511-1fb3-43f7-a431-9b3f5f5febaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:20.891138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 16/28] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:20.891995 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8c340-f7ec-4e21-b1d2-5dad99d72cc0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:20.895479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-33f90511-1fb3-43f7-a431-9b3f5f5febaa None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:20.896924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-33f90511-1fb3-43f7-a431-9b3f5f5febaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:21.005786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 13/29] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:21.024481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:21.030222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8c340-f7ec-4e21-b1d2-5dad99d72cc0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:21.081716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576a380-95fa-42ae-9aed-88b66d746057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:21.082376 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a380-95fa-42ae-9aed-88b66d746057 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:21.082657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a380-95fa-42ae-9aed-88b66d746057 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:21.082933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a380-95fa-42ae-9aed-88b66d746057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:21.097387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576a380-95fa-42ae-9aed-88b66d746057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d576a380-95fa-42ae-9aed-88b66d746057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:21.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:21.107558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:21.108321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 17/30] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:21.114215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f90511-1fb3-43f7-a431-9b3f5f5febaa None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:21.246397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:21.268076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f90511-1fb3-43f7-a431-9b3f5f5febaa None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:21.311495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:21.312116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:21.312401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:21.312680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:21.313359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:21.313667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:21.315610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:21.317715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576a380-95fa-42ae-9aed-88b66d746057 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:21.336528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 14/31] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:21.337756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:21.444689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576a380-95fa-42ae-9aed-88b66d746057 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:21.459998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00b297-c257-4c0d-b862-4a9df1a8292b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:21.483670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33899a-3ce3-463f-a4da-623f4668cc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:21.484633 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33899a-3ce3-463f-a4da-623f4668cc32 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:21.485110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33899a-3ce3-463f-a4da-623f4668cc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:21.485629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33899a-3ce3-463f-a4da-623f4668cc32 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:21.486647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33899a-3ce3-463f-a4da-623f4668cc32 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:21.489752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33899a-3ce3-463f-a4da-623f4668cc32 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:21.500898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d67c9a-26f6-491b-b5f8-cc744de9a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:21.501544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67c9a-26f6-491b-b5f8-cc744de9a984 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:21.502453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67c9a-26f6-491b-b5f8-cc744de9a984 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:21.502818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67c9a-26f6-491b-b5f8-cc744de9a984 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:21.503880 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d67c9a-26f6-491b-b5f8-cc744de9a984 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:21.505448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d67c9a-26f6-491b-b5f8-cc744de9a984 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:21.711238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 18/32] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 22 14:19:21 2022] POST /identity/v3/roles => generated 225 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:19:21.719434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33899a-3ce3-463f-a4da-623f4668cc32 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:21.760130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 22 14:19:21 2022] POST /identity/v3/roles => generated 219 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:21.761830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d67c9a-26f6-491b-b5f8-cc744de9a984 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:21.762719 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:21.797653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:21.973891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d67c9a-26f6-491b-b5f8-cc744de9a984 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:22.008603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33899a-3ce3-463f-a4da-623f4668cc32 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:22.031635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00e9a1-6ad7-4ffd-b15c-0f3dd8263acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:22.032825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00e9a1-6ad7-4ffd-b15c-0f3dd8263acc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.033122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00e9a1-6ad7-4ffd-b15c-0f3dd8263acc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.033406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00e9a1-6ad7-4ffd-b15c-0f3dd8263acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.052528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00e9a1-6ad7-4ffd-b15c-0f3dd8263acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:22.054021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00e9a1-6ad7-4ffd-b15c-0f3dd8263acc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:22.058172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757a260-e1f8-466c-9c6b-ba49383e4cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:22.058835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757a260-e1f8-466c-9c6b-ba49383e4cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.059122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757a260-e1f8-466c-9c6b-ba49383e4cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.059402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757a260-e1f8-466c-9c6b-ba49383e4cd2 None admin] PATH_INFO: `/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.060706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757a260-e1f8-466c-9c6b-ba49383e4cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=83e7a3ec09bb47549d2dc9a48d9658cb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:22.062333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757a260-e1f8-466c-9c6b-ba49383e4cd2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:22.064144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 19/34] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:21 2022] GET /identity/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb => generated 247 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:22.066354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c407d7-de3d-447c-a8df-8b4f5552aaed None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.066354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c407d7-de3d-447c-a8df-8b4f5552aaed None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.066354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c407d7-de3d-447c-a8df-8b4f5552aaed None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.067491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 20/35] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:22.071144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c407d7-de3d-447c-a8df-8b4f5552aaed None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-df00e9a1-6ad7-4ffd-b15c-0f3dd8263acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:19:22.073733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:22.074661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:19:22.075481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:19:22.075481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:19:22.075481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:22.077349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 16/36] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:22.078964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dceaa-c422-43ea-b7b8-3f8782c43e05 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.079447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dceaa-c422-43ea-b7b8-3f8782c43e05 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.079945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dceaa-c422-43ea-b7b8-3f8782c43e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.115138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f00dceaa-c422-43ea-b7b8-3f8782c43e05 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:22.117257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f00dceaa-c422-43ea-b7b8-3f8782c43e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:22.184930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:22.195465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:22.211081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c407d7-de3d-447c-a8df-8b4f5552aaed None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:22.212144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 17/37] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:19:22.213127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dceaa-c422-43ea-b7b8-3f8782c43e05 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:22.257441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516cb48-f2af-48e0-bcdb-391f22f08177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:22.258262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516cb48-f2af-48e0-bcdb-391f22f08177 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.258639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516cb48-f2af-48e0-bcdb-391f22f08177 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.259010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516cb48-f2af-48e0-bcdb-391f22f08177 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.260367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516cb48-f2af-48e0-bcdb-391f22f08177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:22.261961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f516cb48-f2af-48e0-bcdb-391f22f08177 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:22.263741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 21/38] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:22.269753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516cb48-f2af-48e0-bcdb-391f22f08177 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:22.372404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dceaa-c422-43ea-b7b8-3f8782c43e05 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:22.392409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516cb48-f2af-48e0-bcdb-391f22f08177 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:22.434266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5924716-a376-4658-8720-f747ae7b19f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:22.435198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924716-a376-4658-8720-f747ae7b19f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.435716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924716-a376-4658-8720-f747ae7b19f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.436159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5924716-a376-4658-8720-f747ae7b19f9 None admin] PATH_INFO: `/v3/domains/default/users/83e7a3ec09bb47549d2dc9a48d9658cb/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.438539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5924716-a376-4658-8720-f747ae7b19f9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=83e7a3ec09bb47549d2dc9a48d9658cb, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:22.440886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5924716-a376-4658-8720-f747ae7b19f9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:22.518890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec97f2-cbbe-442b-9f2c-81a24636b20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:22.519442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec97f2-cbbe-442b-9f2c-81a24636b20f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.519745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec97f2-cbbe-442b-9f2c-81a24636b20f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.519996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec97f2-cbbe-442b-9f2c-81a24636b20f None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.520643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec97f2-cbbe-442b-9f2c-81a24636b20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:22.520945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec97f2-cbbe-442b-9f2c-81a24636b20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:22.522330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec97f2-cbbe-442b-9f2c-81a24636b20f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:22.535242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 18/39] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:22.536540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06307-3b0f-4329-a2dd-1766895fe84c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.536829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06307-3b0f-4329-a2dd-1766895fe84c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.537103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea06307-3b0f-4329-a2dd-1766895fe84c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.538319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 19/40] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:22.539098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea06307-3b0f-4329-a2dd-1766895fe84c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:22.546867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Sep 22 14:19:22 2022] PUT /identity/v3/domains/default/users/83e7a3ec09bb47549d2dc9a48d9658cb/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:19:22.547678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5924716-a376-4658-8720-f747ae7b19f9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:22.573071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:22.604112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:22.666099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea06307-3b0f-4329-a2dd-1766895fe84c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:22.672459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5924716-a376-4658-8720-f747ae7b19f9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:22.703283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e8a62-d464-4530-9917-6b269e60227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:22.703917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e8a62-d464-4530-9917-6b269e60227c None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.704206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e8a62-d464-4530-9917-6b269e60227c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.704481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e8a62-d464-4530-9917-6b269e60227c None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.705168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e8a62-d464-4530-9917-6b269e60227c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:22.706750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e8a62-d464-4530-9917-6b269e60227c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:22.712812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85f54-d08d-4657-b1cc-42fb71256dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:22.713431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85f54-d08d-4657-b1cc-42fb71256dbc None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.713713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85f54-d08d-4657-b1cc-42fb71256dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.714008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85f54-d08d-4657-b1cc-42fb71256dbc None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.714675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db85f54-d08d-4657-b1cc-42fb71256dbc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:22.716134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db85f54-d08d-4657-b1cc-42fb71256dbc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:22.770344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 20/42] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 22 14:19:22 2022] POST /identity/v3/roles => generated 223 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:22.771569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b9bf7-80f8-4893-9563-5411e0a71059 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:22.771865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b9bf7-80f8-4893-9563-5411e0a71059 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:22.772242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b9bf7-80f8-4893-9563-5411e0a71059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:22.794402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-116b9bf7-80f8-4893-9563-5411e0a71059 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:22.795678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-116b9bf7-80f8-4893-9563-5411e0a71059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:22.822558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 23/43] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:19:22 2022] POST /identity/v3/projects => generated 301 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:22.892972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 21/44] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:23.179389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85f54-d08d-4657-b1cc-42fb71256dbc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:23.248105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:23.286399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85f54-d08d-4657-b1cc-42fb71256dbc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:23.326724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6346a3-e232-41b3-bd04-4c09f15af06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:23.327362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6346a3-e232-41b3-bd04-4c09f15af06d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:23.327641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6346a3-e232-41b3-bd04-4c09f15af06d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:23.327915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6346a3-e232-41b3-bd04-4c09f15af06d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:23.329086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6346a3-e232-41b3-bd04-4c09f15af06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:23.331259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6346a3-e232-41b3-bd04-4c09f15af06d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:23.333320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 24/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:23.338503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b9bf7-80f8-4893-9563-5411e0a71059 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:23.377696 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:23.437483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b9bf7-80f8-4893-9563-5411e0a71059 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:23.473708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2a55-104c-4682-a5a3-4a81004b76e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:23.474348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2a55-104c-4682-a5a3-4a81004b76e7 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:23.474629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2a55-104c-4682-a5a3-4a81004b76e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:23.474900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2a55-104c-4682-a5a3-4a81004b76e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:23.475545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2a55-104c-4682-a5a3-4a81004b76e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:23.476976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2a55-104c-4682-a5a3-4a81004b76e7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:23.564689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:19:23 2022] POST /identity/v3/projects => generated 312 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:24.721047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb43a0-b039-42bb-a7da-71f0e7a45cf2 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:24.722049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb43a0-b039-42bb-a7da-71f0e7a45cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:24.722155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb43a0-b039-42bb-a7da-71f0e7a45cf2 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:24.723504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:24.729268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e2e92-30fa-498e-ae4f-84894e6a961f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:24.729942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e2e92-30fa-498e-ae4f-84894e6a961f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:24.730124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e2e92-30fa-498e-ae4f-84894e6a961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:24.748738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4f9e2e92-30fa-498e-ae4f-84894e6a961f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:24.749925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4f9e2e92-30fa-498e-ae4f-84894e6a961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:24.815836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:25.084120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb43a0-b039-42bb-a7da-71f0e7a45cf2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:25.184917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb43a0-b039-42bb-a7da-71f0e7a45cf2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:25.214933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:25.219796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae5be-6d8a-4b07-910c-16342a86701f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:25.220426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae5be-6d8a-4b07-910c-16342a86701f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:25.220710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae5be-6d8a-4b07-910c-16342a86701f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:25.220983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcae5be-6d8a-4b07-910c-16342a86701f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:25.235168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcae5be-6d8a-4b07-910c-16342a86701f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ddcae5be-6d8a-4b07-910c-16342a86701f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:25.240455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:25.241455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:25.242411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:25.247655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e2e92-30fa-498e-ae4f-84894e6a961f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:25.269420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:25.345715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e2e92-30fa-498e-ae4f-84894e6a961f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:25.379660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:25.380273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:25.380557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:25.380832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:25.381494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:25.381796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:25.383212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:25.391118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 24/50] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:25.397387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae5be-6d8a-4b07-910c-16342a86701f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:25.496572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcae5be-6d8a-4b07-910c-16342a86701f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:25.530791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341d21b-0741-42bc-8bf5-dfaf8f746596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:25.531424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341d21b-0741-42bc-8bf5-dfaf8f746596 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:25.531705 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341d21b-0741-42bc-8bf5-dfaf8f746596 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:25.531980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341d21b-0741-42bc-8bf5-dfaf8f746596 None admin] PATH_INFO: `/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:25.533104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341d21b-0741-42bc-8bf5-dfaf8f746596 None admin] RBAC: Authorizing `identity:get_user(user_id=83e7a3ec09bb47549d2dc9a48d9658cb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:25.534869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341d21b-0741-42bc-8bf5-dfaf8f746596 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:25.536447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 27/51] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:25 2022] GET /identity/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:25.541916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:25.626063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:25.646212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878166b8-d508-4a6d-86e6-4736684f1781 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:25.679822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee19fd-2501-4626-878b-2f5729e07485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:25.680457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee19fd-2501-4626-878b-2f5729e07485 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:25.680741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee19fd-2501-4626-878b-2f5729e07485 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:25.681016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee19fd-2501-4626-878b-2f5729e07485 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:25.682160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee19fd-2501-4626-878b-2f5729e07485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:25.683614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee19fd-2501-4626-878b-2f5729e07485 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:25.685169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 25/52] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:25.691450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341d21b-0741-42bc-8bf5-dfaf8f746596 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:25.732908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372e19-2bc2-4ff5-aa22-2d2d07f56e9e None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:25.733448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372e19-2bc2-4ff5-aa22-2d2d07f56e9e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:25.733448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372e19-2bc2-4ff5-aa22-2d2d07f56e9e None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:25.734797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 26/53] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:25.739961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c609-499f-4a5a-8785-fc2e2f3e49cf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:25.740247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c609-499f-4a5a-8785-fc2e2f3e49cf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:25.740525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6c609-499f-4a5a-8785-fc2e2f3e49cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:25.751179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:25.759432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a9f6c609-499f-4a5a-8785-fc2e2f3e49cf None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:25.760637 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a9f6c609-499f-4a5a-8785-fc2e2f3e49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:25.793040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341d21b-0741-42bc-8bf5-dfaf8f746596 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:25.826506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:25.827109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:25.827390 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:25.827666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:25.827951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:19:25.828395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.domain.id=default, user.id=83e7a3ec09bb47549d2dc9a48d9658cb) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:25.828702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:25.830179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:25.836353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Sep 22 14:19:25 2022] GET /identity/v3/role_assignments?user.id=83e7a3ec09bb47549d2dc9a48d9658cb&scope.domain.id=default&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:26.099036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c609-499f-4a5a-8785-fc2e2f3e49cf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:26.178220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:26.196991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6c609-499f-4a5a-8785-fc2e2f3e49cf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:26.230456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f9c6e-5e30-43ff-847e-8466f8267b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:26.231096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9c6e-5e30-43ff-847e-8466f8267b45 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:26.231385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9c6e-5e30-43ff-847e-8466f8267b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:26.231860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f9c6e-5e30-43ff-847e-8466f8267b45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:26.233501 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f9c6e-5e30-43ff-847e-8466f8267b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:26.234996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f9c6e-5e30-43ff-847e-8466f8267b45 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:26.236572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:26.242775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:26.337813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b567d36-7a3e-42b8-ac9d-324e323bd052 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:26.360148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:26.371166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef49a3-51b5-4954-8bf0-30bd6e27d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:26.371767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef49a3-51b5-4954-8bf0-30bd6e27d398 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:26.372048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef49a3-51b5-4954-8bf0-30bd6e27d398 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:26.372320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef49a3-51b5-4954-8bf0-30bd6e27d398 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:26.372976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef49a3-51b5-4954-8bf0-30bd6e27d398 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:26.374487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef49a3-51b5-4954-8bf0-30bd6e27d398 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:26.444813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Sep 22 14:19:26 2022] POST /identity/v3/projects => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:19:28.595743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609af7-f3a4-41fc-b969-f3a4f429a92b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:28.596234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609af7-f3a4-41fc-b969-f3a4f429a92b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:28.596318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b609af7-f3a4-41fc-b969-f3a4f429a92b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:28.597596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:28.602953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326377-5aa7-4b61-b948-e513b52ff802 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:28.603348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326377-5aa7-4b61-b948-e513b52ff802 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:28.603513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e326377-5aa7-4b61-b948-e513b52ff802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:28.622659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8e326377-5aa7-4b61-b948-e513b52ff802 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:28.624170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8e326377-5aa7-4b61-b948-e513b52ff802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:28.791594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:29.066603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b609af7-f3a4-41fc-b969-f3a4f429a92b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:29.166541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b609af7-f3a4-41fc-b969-f3a4f429a92b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:29.198575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ba0a8-7ae3-451f-a88b-f842be674db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:29.199192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba0a8-7ae3-451f-a88b-f842be674db9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:29.199471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba0a8-7ae3-451f-a88b-f842be674db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:29.199744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba0a8-7ae3-451f-a88b-f842be674db9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:29.200848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ba0a8-7ae3-451f-a88b-f842be674db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:29.202295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ba0a8-7ae3-451f-a88b-f842be674db9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:29.203835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:29.209886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326377-5aa7-4b61-b948-e513b52ff802 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:29.306946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e326377-5aa7-4b61-b948-e513b52ff802 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:29.313547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:29.340380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487a50b-3595-48b2-9083-37f62d875bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:29.341142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487a50b-3595-48b2-9083-37f62d875bfd None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:29.341483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487a50b-3595-48b2-9083-37f62d875bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:29.342138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487a50b-3595-48b2-9083-37f62d875bfd None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:29.342825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487a50b-3595-48b2-9083-37f62d875bfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:29.344287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487a50b-3595-48b2-9083-37f62d875bfd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:29.431559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:19:29 2022] POST /identity/v3/users => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:32.742164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510594e7-3c61-4672-8a03-1062cd451e4f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:32.743069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510594e7-3c61-4672-8a03-1062cd451e4f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:32.743549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510594e7-3c61-4672-8a03-1062cd451e4f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:32.745178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:32.750528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b6f11-ffa7-46ff-a930-106408def74d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:32.751371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b6f11-ffa7-46ff-a930-106408def74d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:32.751832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b6f11-ffa7-46ff-a930-106408def74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:32.775650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-323b6f11-ffa7-46ff-a930-106408def74d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:32.777182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-323b6f11-ffa7-46ff-a930-106408def74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:32.791867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338522-d50a-44af-add3-500e55dfb7e8 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:32.792411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338522-d50a-44af-add3-500e55dfb7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:32.792869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338522-d50a-44af-add3-500e55dfb7e8 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:32.794698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:32.799965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb648f1-9115-4848-8041-e72abe9b628a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:32.800517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb648f1-9115-4848-8041-e72abe9b628a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:32.801006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb648f1-9115-4848-8041-e72abe9b628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:32.832106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ddb648f1-9115-4848-8041-e72abe9b628a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:32.837818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ddb648f1-9115-4848-8041-e72abe9b628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:32.870381 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:32.897873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 32/64] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:32.972716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:19:33.086243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2185-8ce2-4023-8e44-582121768482 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.086853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2185-8ce2-4023-8e44-582121768482 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.087336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2185-8ce2-4023-8e44-582121768482 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.089239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 33/66] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:33.094129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5e03-d1be-4935-8076-05eb142f07dd None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.094638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5e03-d1be-4935-8076-05eb142f07dd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.095111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5e03-d1be-4935-8076-05eb142f07dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.118871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-139b5e03-d1be-4935-8076-05eb142f07dd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:33.120440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-139b5e03-d1be-4935-8076-05eb142f07dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:33.213839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:33.292346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d2185-8ce2-4023-8e44-582121768482 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:33.293394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b5e03-d1be-4935-8076-05eb142f07dd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:33.438443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:33.459561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d2185-8ce2-4023-8e44-582121768482 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:33.482963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:33.510936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18410c34-02c6-4139-8458-92050ffaeac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:33.511990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18410c34-02c6-4139-8458-92050ffaeac6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.512473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18410c34-02c6-4139-8458-92050ffaeac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.512977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18410c34-02c6-4139-8458-92050ffaeac6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.514518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b5e03-d1be-4935-8076-05eb142f07dd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:33.528426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18410c34-02c6-4139-8458-92050ffaeac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-18410c34-02c6-4139-8458-92050ffaeac6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:33.534295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:33.535220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:33.535993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 34/68] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:33.537767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5da7-18cc-4c98-9d38-8a6a2828d4aa None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.538393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5da7-18cc-4c98-9d38-8a6a2828d4aa None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.538675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5da7-18cc-4c98-9d38-8a6a2828d4aa None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.540123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 35/69] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:33.542115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5da7-18cc-4c98-9d38-8a6a2828d4aa None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:33.559948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb786e-b1ac-4eea-a405-1a6a6b457418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:33.560596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb786e-b1ac-4eea-a405-1a6a6b457418 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.560883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb786e-b1ac-4eea-a405-1a6a6b457418 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.561165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb786e-b1ac-4eea-a405-1a6a6b457418 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.573811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb786e-b1ac-4eea-a405-1a6a6b457418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-5ffb786e-b1ac-4eea-a405-1a6a6b457418 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:33.581474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:33.582383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:33.583608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:19:33.584459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb786e-b1ac-4eea-a405-1a6a6b457418 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:33.652247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5da7-18cc-4c98-9d38-8a6a2828d4aa None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:33.685676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb786e-b1ac-4eea-a405-1a6a6b457418 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:33.686642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a7311-0044-4065-8c19-1b400c60714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:33.687348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7311-0044-4065-8c19-1b400c60714f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.687634 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7311-0044-4065-8c19-1b400c60714f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.687920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7311-0044-4065-8c19-1b400c60714f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.697961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a7311-0044-4065-8c19-1b400c60714f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3a1a7311-0044-4065-8c19-1b400c60714f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:33.702760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:33.703738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:33.704839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:19:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:33.706718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d5eaf-0867-4bc8-a564-ae20aa6cdcd8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.706718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d5eaf-0867-4bc8-a564-ae20aa6cdcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.706844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d5eaf-0867-4bc8-a564-ae20aa6cdcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.725352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-142d5eaf-0867-4bc8-a564-ae20aa6cdcd8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:33.726573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-142d5eaf-0867-4bc8-a564-ae20aa6cdcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:33.726676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf6888-a563-4697-acda-fc05e9f94dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:33.727277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6888-a563-4697-acda-fc05e9f94dde None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.727556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6888-a563-4697-acda-fc05e9f94dde None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.727830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf6888-a563-4697-acda-fc05e9f94dde None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.728501 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6888-a563-4697-acda-fc05e9f94dde None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:33.728803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6888-a563-4697-acda-fc05e9f94dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:33.730495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf6888-a563-4697-acda-fc05e9f94dde None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:33.732675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:33.734643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:33.739454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:33.740651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde60de-e12b-4415-921b-6a2dbbf67b52 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.740935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde60de-e12b-4415-921b-6a2dbbf67b52 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.741306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde60de-e12b-4415-921b-6a2dbbf67b52 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.742507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 37/73] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:33.743123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde60de-e12b-4415-921b-6a2dbbf67b52 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:33.794570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 37/74] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:33.795416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d5eaf-0867-4bc8-a564-ae20aa6cdcd8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:33.853362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde60de-e12b-4415-921b-6a2dbbf67b52 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:33.887572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:33.888212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.888491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.888772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.889427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:33.889728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:33.891131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:33.899908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:33.900697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:33.902896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d5eaf-0867-4bc8-a564-ae20aa6cdcd8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:33.943116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22770c0-a8f5-465b-ac28-e8a525fefdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:33.943730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22770c0-a8f5-465b-ac28-e8a525fefdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.944009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22770c0-a8f5-465b-ac28-e8a525fefdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.944283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22770c0-a8f5-465b-ac28-e8a525fefdd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.945445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22770c0-a8f5-465b-ac28-e8a525fefdd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:33.945757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22770c0-a8f5-465b-ac28-e8a525fefdd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:33.947655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22770c0-a8f5-465b-ac28-e8a525fefdd0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:33.958809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 38/76] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:19:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:33.959951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025208f0-72da-4f45-bd1b-48963a1be079 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:33.960245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025208f0-72da-4f45-bd1b-48963a1be079 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:33.960519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025208f0-72da-4f45-bd1b-48963a1be079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:33.967688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:33.970243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:33.978672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-025208f0-72da-4f45-bd1b-48963a1be079 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:33.980421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-025208f0-72da-4f45-bd1b-48963a1be079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:34.010643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678545fb-c432-420c-b4ff-a198f3c8ca4f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.047292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48ad4-b386-4e5e-a4aa-dc5e6b1994c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.047992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48ad4-b386-4e5e-a4aa-dc5e6b1994c0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.048274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48ad4-b386-4e5e-a4aa-dc5e6b1994c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.048778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab48ad4-b386-4e5e-a4aa-dc5e6b1994c0 None admin] PATH_INFO: `/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.050520 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab48ad4-b386-4e5e-a4aa-dc5e6b1994c0 None admin] RBAC: Authorizing `identity:get_user(user_id=83e7a3ec09bb47549d2dc9a48d9658cb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.051983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab48ad4-b386-4e5e-a4aa-dc5e6b1994c0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.053788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:33 2022] GET /identity/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:34.054064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 39/78] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:34.054797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48ad4-b386-4e5e-a4aa-dc5e6b1994c0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.054914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025208f0-72da-4f45-bd1b-48963a1be079 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.159847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab48ad4-b386-4e5e-a4aa-dc5e6b1994c0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.167970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025208f0-72da-4f45-bd1b-48963a1be079 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.187588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:34.195508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c044e5-2757-4091-8d80-c544a7468a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.196106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c044e5-2757-4091-8d80-c544a7468a2d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.196390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c044e5-2757-4091-8d80-c544a7468a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.196675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c044e5-2757-4091-8d80-c544a7468a2d None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.204464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90178-3b2f-4c0f-bb8f-13d14e75975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.209207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90178-3b2f-4c0f-bb8f-13d14e75975a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.209207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90178-3b2f-4c0f-bb8f-13d14e75975a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.209207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c90178-3b2f-4c0f-bb8f-13d14e75975a None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.209207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:34.211154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c044e5-2757-4091-8d80-c544a7468a2d None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.212299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c044e5-2757-4091-8d80-c544a7468a2d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.218612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:34.218612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c044e5-2757-4091-8d80-c544a7468a2d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.230507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c90178-3b2f-4c0f-bb8f-13d14e75975a None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.232115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c90178-3b2f-4c0f-bb8f-13d14e75975a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.238937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 40/80] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:34.238937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90178-3b2f-4c0f-bb8f-13d14e75975a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.324829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c044e5-2757-4091-8d80-c544a7468a2d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.345055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c90178-3b2f-4c0f-bb8f-13d14e75975a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.359315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477ba1c-1e87-4e0c-a97f-6748c43c14ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.359934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ba1c-1e87-4e0c-a97f-6748c43c14ba None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.360218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ba1c-1e87-4e0c-a97f-6748c43c14ba None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.360494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ba1c-1e87-4e0c-a97f-6748c43c14ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.380235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aab68-7350-4521-b03c-b5807e29e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.380859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aab68-7350-4521-b03c-b5807e29e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.381139 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aab68-7350-4521-b03c-b5807e29e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.381413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aab68-7350-4521-b03c-b5807e29e4b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.391738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aab68-7350-4521-b03c-b5807e29e4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-465aab68-7350-4521-b03c-b5807e29e4b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:34.396739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:34.397637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:34.398504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 41/81] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:34.400089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aab68-7350-4521-b03c-b5807e29e4b0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.416478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:34.430057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477ba1c-1e87-4e0c-a97f-6748c43c14ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.431520 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477ba1c-1e87-4e0c-a97f-6748c43c14ba None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.453841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:34.500807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aab68-7350-4521-b03c-b5807e29e4b0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.530288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 41/82] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:34.531303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477ba1c-1e87-4e0c-a97f-6748c43c14ba None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.534103 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715cd59-7e0b-4203-8d7e-9435ec1fa449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.534716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cd59-7e0b-4203-8d7e-9435ec1fa449 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.534998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cd59-7e0b-4203-8d7e-9435ec1fa449 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.535256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715cd59-7e0b-4203-8d7e-9435ec1fa449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.603669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715cd59-7e0b-4203-8d7e-9435ec1fa449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.605406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715cd59-7e0b-4203-8d7e-9435ec1fa449 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.614653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:34.630398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477ba1c-1e87-4e0c-a97f-6748c43c14ba None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.655835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:34.664665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae06bf4-548d-4a61-a776-0d0f5d6a4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.665274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06bf4-548d-4a61-a776-0d0f5d6a4c65 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.665552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06bf4-548d-4a61-a776-0d0f5d6a4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.665824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06bf4-548d-4a61-a776-0d0f5d6a4c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.703827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 42/83] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:34.704660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715cd59-7e0b-4203-8d7e-9435ec1fa449 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.732901 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae06bf4-548d-4a61-a776-0d0f5d6a4c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.734383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae06bf4-548d-4a61-a776-0d0f5d6a4c65 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.804796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715cd59-7e0b-4203-8d7e-9435ec1fa449 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.813841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:34.836128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 42/84] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:34.836128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae06bf4-548d-4a61-a776-0d0f5d6a4c65 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.840406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137b4a2-d853-4f19-ae51-2682e14d9a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.841046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b4a2-d853-4f19-ae51-2682e14d9a8f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.841331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b4a2-d853-4f19-ae51-2682e14d9a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.842044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b4a2-d853-4f19-ae51-2682e14d9a8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.843173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137b4a2-d853-4f19-ae51-2682e14d9a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.844621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137b4a2-d853-4f19-ae51-2682e14d9a8f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.846416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 43/85] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:34.847062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137b4a2-d853-4f19-ae51-2682e14d9a8f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.869608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:34.933211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae06bf4-548d-4a61-a776-0d0f5d6a4c65 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.945932 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137b4a2-d853-4f19-ae51-2682e14d9a8f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:34.966529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.967149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.967435 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.967702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.968369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:34.968668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.970063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.977736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 43/86] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:34.978555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:34.978786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efbbd5-b6b9-40d5-a20b-9e1cfea98f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:34.979676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbbd5-b6b9-40d5-a20b-9e1cfea98f2c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:34.979959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbbd5-b6b9-40d5-a20b-9e1cfea98f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:34.980234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbbd5-b6b9-40d5-a20b-9e1cfea98f2c None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:34.981384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efbbd5-b6b9-40d5-a20b-9e1cfea98f2c None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:34.982918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efbbd5-b6b9-40d5-a20b-9e1cfea98f2c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:34.984494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 44/87] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:34.985250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efbbd5-b6b9-40d5-a20b-9e1cfea98f2c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:35.037819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:35.073895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:35.085732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efbbd5-b6b9-40d5-a20b-9e1cfea98f2c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:35.088371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53f1f-3b53-4627-8ecf-68fd7825aba4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:35.119628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dd729-fa15-4abe-bcc5-cafb17c489d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:35.120255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dd729-fa15-4abe-bcc5-cafb17c489d1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:35.120535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dd729-fa15-4abe-bcc5-cafb17c489d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:35.120808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793dd729-fa15-4abe-bcc5-cafb17c489d1 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:35.121827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60018-c86a-4e7d-9c01-701711787e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:35.121953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dd729-fa15-4abe-bcc5-cafb17c489d1 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:35.122498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60018-c86a-4e7d-9c01-701711787e11 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:35.122783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60018-c86a-4e7d-9c01-701711787e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:35.123061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60018-c86a-4e7d-9c01-701711787e11 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:35.123382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793dd729-fa15-4abe-bcc5-cafb17c489d1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:35.124192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a60018-c86a-4e7d-9c01-701711787e11 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:35.124997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 45/88] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:35.125617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a60018-c86a-4e7d-9c01-701711787e11 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:35.125715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dd729-fa15-4abe-bcc5-cafb17c489d1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:35.130114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 44/89] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:34 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:35.131165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60018-c86a-4e7d-9c01-701711787e11 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:35.229563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60018-c86a-4e7d-9c01-701711787e11 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:35.231121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793dd729-fa15-4abe-bcc5-cafb17c489d1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:35.248062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:35.265429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc6589-27ac-44a9-a90e-806a98ccfc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:35.266215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53567496-88c9-4837-a3d6-7e9d03c077e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:35.266332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc6589-27ac-44a9-a90e-806a98ccfc93 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:35.266505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc6589-27ac-44a9-a90e-806a98ccfc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:35.266778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc6589-27ac-44a9-a90e-806a98ccfc93 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:35.266878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53567496-88c9-4837-a3d6-7e9d03c077e1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:35.267127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53567496-88c9-4837-a3d6-7e9d03c077e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:35.267409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53567496-88c9-4837-a3d6-7e9d03c077e1 None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:35.267492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc6589-27ac-44a9-a90e-806a98ccfc93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:35.269008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc6589-27ac-44a9-a90e-806a98ccfc93 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:35.269220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53567496-88c9-4837-a3d6-7e9d03c077e1 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:35.270695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53567496-88c9-4837-a3d6-7e9d03c077e1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:35.274270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 45/90] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:35 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:35.274946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53567496-88c9-4837-a3d6-7e9d03c077e1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:35.330758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 46/91] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:19:35 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:35.331544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc6589-27ac-44a9-a90e-806a98ccfc93 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:35.348630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:35.384629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53567496-88c9-4837-a3d6-7e9d03c077e1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:35.425121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:35.425818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:35.426137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:35.426407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:35.427785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=52a1f0f883b14fd1832cf21670c5a803, user.id=83e7a3ec09bb47549d2dc9a48d9658cb) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:35.428102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:35.430007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:35.446011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:35 2022] GET /identity/v3/role_assignments?user.id=83e7a3ec09bb47549d2dc9a48d9658cb&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:35.446011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:35.454791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc6589-27ac-44a9-a90e-806a98ccfc93 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:35.499424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:35.500050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:35.500334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:35.500609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:35.501480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] RBAC: Adding query filter params (role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=52a1f0f883b14fd1832cf21670c5a803, user.id=4f6db55a18244f29a68c5c078374063f) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:35.501790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:35.503607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:35.510150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:35.511869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 47/93] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:35 2022] GET /identity/v3/role_assignments?user.id=4f6db55a18244f29a68c5c078374063f&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:35.512758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:35.583294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da2d75-681b-4ec9-8bfc-c77d50561477 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:35.612711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:35.635032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:35.636018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:35.636475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:35.636921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:35.637849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] RBAC: Adding query filter params (role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=52a1f0f883b14fd1832cf21670c5a803, user.id=4f6db55a18244f29a68c5c078374063f) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:35.638398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:35.640105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:35.640309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c897fd8-aec7-43d2-921e-24598afdb416 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:35.646972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 47/94] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:35 2022] GET /identity/v3/role_assignments?user.id=4f6db55a18244f29a68c5c078374063f&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:35.685335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1324736-edd1-4814-ac0f-8c4a03ad6198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:35.686057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324736-edd1-4814-ac0f-8c4a03ad6198 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:35.686352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324736-edd1-4814-ac0f-8c4a03ad6198 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:35.686632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324736-edd1-4814-ac0f-8c4a03ad6198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:35.771250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1324736-edd1-4814-ac0f-8c4a03ad6198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:35.772754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1324736-edd1-4814-ac0f-8c4a03ad6198 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:35.871436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:35.897867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 48/95] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:35.904152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:36.060439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513108b6-8999-4086-9745-18d2a336d2ab None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:36.078161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:36.105059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe0694-5123-4e77-8028-cc943a0c733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:36.105777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe0694-5123-4e77-8028-cc943a0c733a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:36.106905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe0694-5123-4e77-8028-cc943a0c733a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:36.107186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe0694-5123-4e77-8028-cc943a0c733a None admin] PATH_INFO: `/v3/projects/462b13bf9b0d4c21b547ba0494f01884` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:36.108364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe0694-5123-4e77-8028-cc943a0c733a None admin] RBAC: Authorizing `identity:get_project(project_id=462b13bf9b0d4c21b547ba0494f01884)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:36.109834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe0694-5123-4e77-8028-cc943a0c733a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:36.111805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 48/96] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:35 2022] GET /identity/v3/projects/462b13bf9b0d4c21b547ba0494f01884 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:36.117641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1324736-edd1-4814-ac0f-8c4a03ad6198 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:36.243169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1324736-edd1-4814-ac0f-8c4a03ad6198 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:36.287893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab22ba5-b5ce-4afc-b2d7-5920e15c67e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:36.288514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22ba5-b5ce-4afc-b2d7-5920e15c67e6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:36.288797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22ba5-b5ce-4afc-b2d7-5920e15c67e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:36.289073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22ba5-b5ce-4afc-b2d7-5920e15c67e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:36.289810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab22ba5-b5ce-4afc-b2d7-5920e15c67e6 None admin] RBAC: Adding query filter params (role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=462b13bf9b0d4c21b547ba0494f01884, user.id=4f6db55a18244f29a68c5c078374063f) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:36.290166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab22ba5-b5ce-4afc-b2d7-5920e15c67e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:36.291626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab22ba5-b5ce-4afc-b2d7-5920e15c67e6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:36.297630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 49/97] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:36 2022] GET /identity/v3/role_assignments?user.id=4f6db55a18244f29a68c5c078374063f&scope.project.id=462b13bf9b0d4c21b547ba0494f01884&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:38.215902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526e87-8af8-4170-ab84-f056c66ae214 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:38.216518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526e87-8af8-4170-ab84-f056c66ae214 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:38.216518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526e87-8af8-4170-ab84-f056c66ae214 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:38.218126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 49/98] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:38.224047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6af36-5d50-4af4-ae40-6dbabb454041 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:38.224513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6af36-5d50-4af4-ae40-6dbabb454041 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:38.224716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6af36-5d50-4af4-ae40-6dbabb454041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:38.251135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c9e6af36-5d50-4af4-ae40-6dbabb454041 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:38.253007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c9e6af36-5d50-4af4-ae40-6dbabb454041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:38.318991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:38.341588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 50/99] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:38.460645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7049-a473-45b0-bfb6-69db1b0d0b8b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:38.460961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7049-a473-45b0-bfb6-69db1b0d0b8b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:38.461210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7049-a473-45b0-bfb6-69db1b0d0b8b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:38.462649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 50/100] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:38.475240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2051-ce8b-40d8-891c-111824763918 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:38.475568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2051-ce8b-40d8-891c-111824763918 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:38.475856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2051-ce8b-40d8-891c-111824763918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:38.507016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-78df2051-ce8b-40d8-891c-111824763918 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:38.508244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-78df2051-ce8b-40d8-891c-111824763918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:38.602280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:19:38.670471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09540f8-421f-473a-9cdb-ea8fb664b766 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:38.670811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09540f8-421f-473a-9cdb-ea8fb664b766 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:38.671037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09540f8-421f-473a-9cdb-ea8fb664b766 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:38.672714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 51/102] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:38.679571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d363b43-70df-4a44-b9d1-1342eacb2bd8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:38.679863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d363b43-70df-4a44-b9d1-1342eacb2bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:38.680146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d363b43-70df-4a44-b9d1-1342eacb2bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:38.703866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8d363b43-70df-4a44-b9d1-1342eacb2bd8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:38.705080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8d363b43-70df-4a44-b9d1-1342eacb2bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:38.782276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09540f8-421f-473a-9cdb-ea8fb664b766 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:38.799863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 52/103] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:38.939006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09540f8-421f-473a-9cdb-ea8fb664b766 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.023906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d363b43-70df-4a44-b9d1-1342eacb2bd8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.047546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf20f8-f129-4fa7-b4bb-19027cc315ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.048108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf20f8-f129-4fa7-b4bb-19027cc315ad None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.048395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf20f8-f129-4fa7-b4bb-19027cc315ad None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.048670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf20f8-f129-4fa7-b4bb-19027cc315ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.069231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:39.069525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf20f8-f129-4fa7-b4bb-19027cc315ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-5adf20f8-f129-4fa7-b4bb-19027cc315ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:39.082190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:39.083805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:39.084682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 52/104] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:39.091768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf20f8-f129-4fa7-b4bb-19027cc315ad None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.176874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:39.202032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d363b43-70df-4a44-b9d1-1342eacb2bd8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.270895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bdadc-738c-41bd-8d98-bfaaa0d17601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.271679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bdadc-738c-41bd-8d98-bfaaa0d17601 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.271869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bdadc-738c-41bd-8d98-bfaaa0d17601 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.272155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bdadc-738c-41bd-8d98-bfaaa0d17601 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.284582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf20f8-f129-4fa7-b4bb-19027cc315ad None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.291383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bdadc-738c-41bd-8d98-bfaaa0d17601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3f9bdadc-738c-41bd-8d98-bfaaa0d17601 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:39.296517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:39.297349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:39.298817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 53/105] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:19:39.311901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bdadc-738c-41bd-8d98-bfaaa0d17601 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.354738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa3501-b762-4dba-8002-3d59bd14e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.355480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3501-b762-4dba-8002-3d59bd14e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.355767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3501-b762-4dba-8002-3d59bd14e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.356045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa3501-b762-4dba-8002-3d59bd14e8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.356787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa3501-b762-4dba-8002-3d59bd14e8d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:39.357098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa3501-b762-4dba-8002-3d59bd14e8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:39.359193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa3501-b762-4dba-8002-3d59bd14e8d7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:39.368540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 53/106] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:39.370071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75e783-a83c-4d45-b8fe-c882824dbb0d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.370570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75e783-a83c-4d45-b8fe-c882824dbb0d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.371069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75e783-a83c-4d45-b8fe-c882824dbb0d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.372508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 54/107] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:39.373409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75e783-a83c-4d45-b8fe-c882824dbb0d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.427428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:39.440370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bdadc-738c-41bd-8d98-bfaaa0d17601 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.483919 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982cc8a-9bcf-4dca-9352-c62501e3ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.484916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cc8a-9bcf-4dca-9352-c62501e3ec91 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.485399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cc8a-9bcf-4dca-9352-c62501e3ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.485883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cc8a-9bcf-4dca-9352-c62501e3ec91 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.487498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982cc8a-9bcf-4dca-9352-c62501e3ec91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:39.488174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982cc8a-9bcf-4dca-9352-c62501e3ec91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:39.490027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982cc8a-9bcf-4dca-9352-c62501e3ec91 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:39.499917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 54/108] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:39.501724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125ce5-8f7a-4825-a16a-03e895345cdd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.502776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125ce5-8f7a-4825-a16a-03e895345cdd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.503388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125ce5-8f7a-4825-a16a-03e895345cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.515663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75e783-a83c-4d45-b8fe-c882824dbb0d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.517557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:39.525546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ea125ce5-8f7a-4825-a16a-03e895345cdd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:39.527209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ea125ce5-8f7a-4825-a16a-03e895345cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:39.566023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44bebd-0705-4884-902f-8d851dd874fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.566618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44bebd-0705-4884-902f-8d851dd874fa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.566909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44bebd-0705-4884-902f-8d851dd874fa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.567189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44bebd-0705-4884-902f-8d851dd874fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.581416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44bebd-0705-4884-902f-8d851dd874fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-8c44bebd-0705-4884-902f-8d851dd874fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:39.588531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:39.589462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:39.590280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 55/109] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:39.590946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44bebd-0705-4884-902f-8d851dd874fa None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.609001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 55/110] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:39.618939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125ce5-8f7a-4825-a16a-03e895345cdd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.703862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44bebd-0705-4884-902f-8d851dd874fa None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.716095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:39.735911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125ce5-8f7a-4825-a16a-03e895345cdd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.740353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9c610-6b4d-4b8d-a3d0-543d1f53adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.740997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c610-6b4d-4b8d-a3d0-543d1f53adf5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.741282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c610-6b4d-4b8d-a3d0-543d1f53adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.741562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c610-6b4d-4b8d-a3d0-543d1f53adf5 None admin] PATH_INFO: `/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.742728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9c610-6b4d-4b8d-a3d0-543d1f53adf5 None admin] RBAC: Authorizing `identity:get_user(user_id=83e7a3ec09bb47549d2dc9a48d9658cb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:39.744201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9c610-6b4d-4b8d-a3d0-543d1f53adf5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:39.745794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 56/111] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:39.747057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33886c-e8d3-4079-a85c-73378b9ae84b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.747329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33886c-e8d3-4079-a85c-73378b9ae84b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.747607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33886c-e8d3-4079-a85c-73378b9ae84b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.748954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 57/112] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:39.749508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33886c-e8d3-4079-a85c-73378b9ae84b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.776982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695096ce-9575-415a-8e76-c532fc336dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.777617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695096ce-9575-415a-8e76-c532fc336dbc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.777904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695096ce-9575-415a-8e76-c532fc336dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.778210 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695096ce-9575-415a-8e76-c532fc336dbc None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.779364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695096ce-9575-415a-8e76-c532fc336dbc None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:39.780843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695096ce-9575-415a-8e76-c532fc336dbc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:39.781487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:39.782459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 56/113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:39.782459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87576d-e494-4066-a3b9-ee53b4fa54c7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.782459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87576d-e494-4066-a3b9-ee53b4fa54c7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.782459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87576d-e494-4066-a3b9-ee53b4fa54c7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.782459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 57/114] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:39.782459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87576d-e494-4066-a3b9-ee53b4fa54c7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.867239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33886c-e8d3-4079-a85c-73378b9ae84b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.893668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87576d-e494-4066-a3b9-ee53b4fa54c7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:39.902175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9673892-3bd4-4f11-83c0-bacb3a882bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.902804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673892-3bd4-4f11-83c0-bacb3a882bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.903087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673892-3bd4-4f11-83c0-bacb3a882bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.903363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9673892-3bd4-4f11-83c0-bacb3a882bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.904033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9673892-3bd4-4f11-83c0-bacb3a882bf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:39.904508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9673892-3bd4-4f11-83c0-bacb3a882bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:39.905963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9673892-3bd4-4f11-83c0-bacb3a882bf1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:39.914588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 58/115] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:39.920502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2440e-0cee-4130-ba39-215e8797983c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.920797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2440e-0cee-4130-ba39-215e8797983c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.921081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2440e-0cee-4130-ba39-215e8797983c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.927737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cddeb2-a1c3-4807-a93a-a939eb9f6dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:39.928362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cddeb2-a1c3-4807-a93a-a939eb9f6dbb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:39.928643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cddeb2-a1c3-4807-a93a-a939eb9f6dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:39.928915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cddeb2-a1c3-4807-a93a-a939eb9f6dbb None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:39.930054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cddeb2-a1c3-4807-a93a-a939eb9f6dbb None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:39.931463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cddeb2-a1c3-4807-a93a-a939eb9f6dbb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:39.933070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 58/116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:39.933821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cddeb2-a1c3-4807-a93a-a939eb9f6dbb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:39.944002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-46e2440e-0cee-4130-ba39-215e8797983c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:39.945230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-46e2440e-0cee-4130-ba39-215e8797983c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:39.954439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:40.013204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 59/117] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:40.015289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0d56-c79f-4114-8bb7-5d34b5b913f7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.015582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0d56-c79f-4114-8bb7-5d34b5b913f7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.016304 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0d56-c79f-4114-8bb7-5d34b5b913f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.038407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-61ac0d56-c79f-4114-8bb7-5d34b5b913f7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:40.040279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-61ac0d56-c79f-4114-8bb7-5d34b5b913f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:40.043040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cddeb2-a1c3-4807-a93a-a939eb9f6dbb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.057548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:40.081747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e209a62-8fac-453a-8ae7-522fa0309458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.082412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e209a62-8fac-453a-8ae7-522fa0309458 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.082693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e209a62-8fac-453a-8ae7-522fa0309458 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.082965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e209a62-8fac-453a-8ae7-522fa0309458 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.084083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e209a62-8fac-453a-8ae7-522fa0309458 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:40.085516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e209a62-8fac-453a-8ae7-522fa0309458 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:40.092182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 59/118] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:39 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:40.092182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e209a62-8fac-453a-8ae7-522fa0309458 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.114284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 60/119] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:40.123930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac0d56-c79f-4114-8bb7-5d34b5b913f7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.194792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:40.212014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e209a62-8fac-453a-8ae7-522fa0309458 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.253099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac0d56-c79f-4114-8bb7-5d34b5b913f7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.262927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447306-d245-4273-89df-ac955dcf5025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.263645 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447306-d245-4273-89df-ac955dcf5025 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.263997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447306-d245-4273-89df-ac955dcf5025 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.264342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447306-d245-4273-89df-ac955dcf5025 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.276956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a447306-d245-4273-89df-ac955dcf5025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7a447306-d245-4273-89df-ac955dcf5025 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:40.282692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:40.284316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:40.285369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:40.286140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 60/120] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:40.290840 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447306-d245-4273-89df-ac955dcf5025 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.298328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a782d6-f2e4-40b6-8843-507302e7c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.299040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a782d6-f2e4-40b6-8843-507302e7c726 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.299322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a782d6-f2e4-40b6-8843-507302e7c726 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.299599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a782d6-f2e4-40b6-8843-507302e7c726 None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.301173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a782d6-f2e4-40b6-8843-507302e7c726 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:40.303052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a782d6-f2e4-40b6-8843-507302e7c726 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:40.305272 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 61/121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:40 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:40.306859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a782d6-f2e4-40b6-8843-507302e7c726 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.332261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:40.404481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447306-d245-4273-89df-ac955dcf5025 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.413805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a782d6-f2e4-40b6-8843-507302e7c726 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.438209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed2c90-0ca3-40ec-81bb-50138667b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.438874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2c90-0ca3-40ec-81bb-50138667b63e None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.439158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2c90-0ca3-40ec-81bb-50138667b63e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.439547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2c90-0ca3-40ec-81bb-50138667b63e None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803/users/83e7a3ec09bb47549d2dc9a48d9658cb/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.441496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed2c90-0ca3-40ec-81bb-50138667b63e None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1f0f883b14fd1832cf21670c5a803, user_id=83e7a3ec09bb47549d2dc9a48d9658cb, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:40.442981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed2c90-0ca3-40ec-81bb-50138667b63e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:40.447053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244f2b4-8cad-4bd0-aee4-f977bfa6f67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.447716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244f2b4-8cad-4bd0-aee4-f977bfa6f67e None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.447998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244f2b4-8cad-4bd0-aee4-f977bfa6f67e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.448272 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244f2b4-8cad-4bd0-aee4-f977bfa6f67e None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803/users/4f6db55a18244f29a68c5c078374063f/roles/6ab17e0fb4c647c690842276bdf39eeb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.450439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244f2b4-8cad-4bd0-aee4-f977bfa6f67e None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1f0f883b14fd1832cf21670c5a803, user_id=4f6db55a18244f29a68c5c078374063f, role_id=6ab17e0fb4c647c690842276bdf39eeb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:40.451860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244f2b4-8cad-4bd0-aee4-f977bfa6f67e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:40.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 61/122] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:19:40 2022] PUT /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803/users/83e7a3ec09bb47549d2dc9a48d9658cb/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:19:40.529250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed2c90-0ca3-40ec-81bb-50138667b63e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.538296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:40.548045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 62/123] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:19:40 2022] PUT /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803/users/4f6db55a18244f29a68c5c078374063f/roles/6ab17e0fb4c647c690842276bdf39eeb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:19:40.563205 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244f2b4-8cad-4bd0-aee4-f977bfa6f67e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.683051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed2c90-0ca3-40ec-81bb-50138667b63e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.693250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:40.719850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244f2b4-8cad-4bd0-aee4-f977bfa6f67e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.741623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73d31a-a9d5-4107-9e4d-5353b9c65c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.742764 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73d31a-a9d5-4107-9e4d-5353b9c65c7a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.743640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73d31a-a9d5-4107-9e4d-5353b9c65c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.744383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73d31a-a9d5-4107-9e4d-5353b9c65c7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.746083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73d31a-a9d5-4107-9e4d-5353b9c65c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:40.748219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73d31a-a9d5-4107-9e4d-5353b9c65c7a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:40.750125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 62/124] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:40.754026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73d31a-a9d5-4107-9e4d-5353b9c65c7a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.776412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.777340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.777627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.777911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.778623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:40.778933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:40.781524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:40.792194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 63/125] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:40.793040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.838965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:40.866363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73d31a-a9d5-4107-9e4d-5353b9c65c7a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.910158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284f35a-3066-4ec2-ae7b-f6cfc03b2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.911352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f35a-3066-4ec2-ae7b-f6cfc03b2502 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.912053 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f35a-3066-4ec2-ae7b-f6cfc03b2502 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.912508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284f35a-3066-4ec2-ae7b-f6cfc03b2502 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.914549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284f35a-3066-4ec2-ae7b-f6cfc03b2502 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:40.917119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284f35a-3066-4ec2-ae7b-f6cfc03b2502 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:40.919066 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 63/126] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:40 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:40.919172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493d19c-99ab-4d4c-ae4e-b264c060233e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:40.920191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284f35a-3066-4ec2-ae7b-f6cfc03b2502 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.957008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3743-2113-4492-86fe-88740fa00c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:40.957711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3743-2113-4492-86fe-88740fa00c54 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:40.958105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3743-2113-4492-86fe-88740fa00c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:40.958452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd3743-2113-4492-86fe-88740fa00c54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:40.969734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd3743-2113-4492-86fe-88740fa00c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0ecd3743-2113-4492-86fe-88740fa00c54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:40.976193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:40.977153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:40.977942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 64/127] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:40.982442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3743-2113-4492-86fe-88740fa00c54 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:40.988397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:41.058328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284f35a-3066-4ec2-ae7b-f6cfc03b2502 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:41.097456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a570-5c93-46b1-ab3d-caae41627838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:41.098109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a570-5c93-46b1-ab3d-caae41627838 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:41.098628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a570-5c93-46b1-ab3d-caae41627838 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:41.098628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260a570-5c93-46b1-ab3d-caae41627838 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:41.099303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a570-5c93-46b1-ab3d-caae41627838 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:41.100813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260a570-5c93-46b1-ab3d-caae41627838 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:41.116745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd3743-2113-4492-86fe-88740fa00c54 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:41.117553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:41.153871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49139b1e-66bb-44c8-9040-ee1f46283047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:41.154543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49139b1e-66bb-44c8-9040-ee1f46283047 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:41.154823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49139b1e-66bb-44c8-9040-ee1f46283047 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:41.155098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49139b1e-66bb-44c8-9040-ee1f46283047 None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:41.156279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49139b1e-66bb-44c8-9040-ee1f46283047 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:41.157732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49139b1e-66bb-44c8-9040-ee1f46283047 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:41.159967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 65/128] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:40 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:41.160717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49139b1e-66bb-44c8-9040-ee1f46283047 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:41.197533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 64/129] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:19:40 2022] POST /identity/v3/projects => generated 302 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:41.197533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a570-5c93-46b1-ab3d-caae41627838 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:41.287916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:41.352155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49139b1e-66bb-44c8-9040-ee1f46283047 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:41.398308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260a570-5c93-46b1-ab3d-caae41627838 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:41.421843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee16100-3ffb-4470-aeab-4e7a4274908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:41.422563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee16100-3ffb-4470-aeab-4e7a4274908d None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:41.422846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee16100-3ffb-4470-aeab-4e7a4274908d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:41.423125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee16100-3ffb-4470-aeab-4e7a4274908d None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803/users/4f6db55a18244f29a68c5c078374063f/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:41.427383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee16100-3ffb-4470-aeab-4e7a4274908d None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1f0f883b14fd1832cf21670c5a803, user_id=4f6db55a18244f29a68c5c078374063f, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:41.430038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee16100-3ffb-4470-aeab-4e7a4274908d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:41.455760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:41.456381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:41.456655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:41.456924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:41.457596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:41.457912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:41.459295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:41.467998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 65/130] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:41.468632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:41.531359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:41.541949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 66/131] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:19:41 2022] PUT /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803/users/4f6db55a18244f29a68c5c078374063f/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:19:41.542697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee16100-3ffb-4470-aeab-4e7a4274908d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:41.593695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2776883-f108-4901-87a7-1546bced2198 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:41.650344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eefae-b316-4895-9009-445a9dfc52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:41.650996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eefae-b316-4895-9009-445a9dfc52b4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:41.651275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eefae-b316-4895-9009-445a9dfc52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:41.651553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eefae-b316-4895-9009-445a9dfc52b4 None admin] PATH_INFO: `/v3/projects/462b13bf9b0d4c21b547ba0494f01884` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:41.652832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1eefae-b316-4895-9009-445a9dfc52b4 None admin] RBAC: Authorizing `identity:get_project(project_id=462b13bf9b0d4c21b547ba0494f01884)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:41.655672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1eefae-b316-4895-9009-445a9dfc52b4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:41.657315 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 66/132] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:41 2022] GET /identity/v3/projects/462b13bf9b0d4c21b547ba0494f01884 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:41.664237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eefae-b316-4895-9009-445a9dfc52b4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:41.760229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee16100-3ffb-4470-aeab-4e7a4274908d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:41.785685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eefae-b316-4895-9009-445a9dfc52b4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:41.814439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:41.835598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1733ca-352d-42dd-98c4-2171239131b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:41.836277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1733ca-352d-42dd-98c4-2171239131b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:41.836559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1733ca-352d-42dd-98c4-2171239131b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:41.836874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1733ca-352d-42dd-98c4-2171239131b4 None admin] PATH_INFO: `/v3/projects/462b13bf9b0d4c21b547ba0494f01884/users/4f6db55a18244f29a68c5c078374063f/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:41.839799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:41.840125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1733ca-352d-42dd-98c4-2171239131b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=462b13bf9b0d4c21b547ba0494f01884, user_id=4f6db55a18244f29a68c5c078374063f, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:41.841595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1733ca-352d-42dd-98c4-2171239131b4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:41.856398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53ba80-309a-4f61-9656-c7dce9afb937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:41.857065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ba80-309a-4f61-9656-c7dce9afb937 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:41.857351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ba80-309a-4f61-9656-c7dce9afb937 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:41.857629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53ba80-309a-4f61-9656-c7dce9afb937 None admin] PATH_INFO: `/v3/users/21230ac17b524cbbb6cea41700cdc066` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:41.878577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53ba80-309a-4f61-9656-c7dce9afb937 None admin] RBAC: Authorizing `identity:get_user(user_id=21230ac17b524cbbb6cea41700cdc066)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:41.880149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53ba80-309a-4f61-9656-c7dce9afb937 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:41.881925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 67/133] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:41 2022] GET /identity/v3/users/21230ac17b524cbbb6cea41700cdc066 => generated 289 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:41.889141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53ba80-309a-4f61-9656-c7dce9afb937 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:41.895442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 67/134] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:19:41 2022] PUT /identity/v3/projects/462b13bf9b0d4c21b547ba0494f01884/users/4f6db55a18244f29a68c5c078374063f/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:19:42.052309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53ba80-309a-4f61-9656-c7dce9afb937 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:42.091795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db7561-2c05-4c88-8c76-146c3d2d1c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:42.092432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7561-2c05-4c88-8c76-146c3d2d1c17 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:42.092716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7561-2c05-4c88-8c76-146c3d2d1c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:42.092995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db7561-2c05-4c88-8c76-146c3d2d1c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:42.183089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:42.196384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db7561-2c05-4c88-8c76-146c3d2d1c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:42.197871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db7561-2c05-4c88-8c76-146c3d2d1c17 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:42.331529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 68/135] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 14:19:42.336690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1733ca-352d-42dd-98c4-2171239131b4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:42.474337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1733ca-352d-42dd-98c4-2171239131b4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:42.511480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc4b91-4df8-4ce4-83a0-5ab6c5a9c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:42.512114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4b91-4df8-4ce4-83a0-5ab6c5a9c806 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:42.512398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4b91-4df8-4ce4-83a0-5ab6c5a9c806 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:42.512676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4b91-4df8-4ce4-83a0-5ab6c5a9c806 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:42.513811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc4b91-4df8-4ce4-83a0-5ab6c5a9c806 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:42.515299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc4b91-4df8-4ce4-83a0-5ab6c5a9c806 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:42.516913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 68/136] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:42 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:42.522876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db7561-2c05-4c88-8c76-146c3d2d1c17 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:42.635279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:42.648155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db7561-2c05-4c88-8c76-146c3d2d1c17 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:42.694405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c501c5-816b-4de5-b05c-c19371f38792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:42.695027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c501c5-816b-4de5-b05c-c19371f38792 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:42.695308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c501c5-816b-4de5-b05c-c19371f38792 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:42.695578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c501c5-816b-4de5-b05c-c19371f38792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:42.696310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c501c5-816b-4de5-b05c-c19371f38792 None admin] RBAC: Adding query filter params (role.id=b79d313a30ab46dca3bc5d0b3caca61a, scope.project.id=52a1f0f883b14fd1832cf21670c5a803, user.id=21230ac17b524cbbb6cea41700cdc066) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:42.696617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c501c5-816b-4de5-b05c-c19371f38792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:42.698076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c501c5-816b-4de5-b05c-c19371f38792 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:42.703953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 69/137] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:42 2022] GET /identity/v3/role_assignments?user.id=21230ac17b524cbbb6cea41700cdc066&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=b79d313a30ab46dca3bc5d0b3caca61a => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:43.394789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540cce3-cda4-44eb-a42d-a2fc928be2d0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:43.395186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540cce3-cda4-44eb-a42d-a2fc928be2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:43.395358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540cce3-cda4-44eb-a42d-a2fc928be2d0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:43.396695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 69/138] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:43.402187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981108-325e-48e7-b87f-31bd580f1b0d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:43.402476 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981108-325e-48e7-b87f-31bd580f1b0d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:43.402752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9981108-325e-48e7-b87f-31bd580f1b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:43.425521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e9981108-325e-48e7-b87f-31bd580f1b0d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:43.426754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e9981108-325e-48e7-b87f-31bd580f1b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:43.488659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7976cd1-f2bb-43ce-bf2f-835448318613 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:43.489189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7976cd1-f2bb-43ce-bf2f-835448318613 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:43.489189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7976cd1-f2bb-43ce-bf2f-835448318613 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:43.490570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 70/139] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:43.496748 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e230a-e747-4857-9858-247cd20dbed6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:43.496964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e230a-e747-4857-9858-247cd20dbed6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:43.497245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e230a-e747-4857-9858-247cd20dbed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:43.517414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3c3e230a-e747-4857-9858-247cd20dbed6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:43.519666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3c3e230a-e747-4857-9858-247cd20dbed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:43.527856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 70/140] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:43.596796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:43.623282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 71/141] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:19:44.105685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9981108-325e-48e7-b87f-31bd580f1b0d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:44.143978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e230a-e747-4857-9858-247cd20dbed6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:44.241599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:44.262088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e230a-e747-4857-9858-247cd20dbed6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:44.294027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9981108-325e-48e7-b87f-31bd580f1b0d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:44.302451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b0334-c136-40f6-8d8f-0ebd751a51fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:44.303095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b0334-c136-40f6-8d8f-0ebd751a51fe None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:44.303381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b0334-c136-40f6-8d8f-0ebd751a51fe None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:44.303660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b0334-c136-40f6-8d8f-0ebd751a51fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:44.319862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b0334-c136-40f6-8d8f-0ebd751a51fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-756b0334-c136-40f6-8d8f-0ebd751a51fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:44.325135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:44.326150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:44.326968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 72/142] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:19:44.327637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd307a-940f-43d7-b884-71d392c3fa66 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:44.333998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd307a-940f-43d7-b884-71d392c3fa66 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:44.333998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd307a-940f-43d7-b884-71d392c3fa66 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:44.335665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 73/143] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:44.336449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd307a-940f-43d7-b884-71d392c3fa66 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:44.377797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209fa0-14e7-4d7d-997c-91624b255b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:44.378376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209fa0-14e7-4d7d-997c-91624b255b11 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:44.378656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209fa0-14e7-4d7d-997c-91624b255b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:44.378928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209fa0-14e7-4d7d-997c-91624b255b11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:44.388651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:44.407124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61209fa0-14e7-4d7d-997c-91624b255b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-61209fa0-14e7-4d7d-997c-91624b255b11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:44.414374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:44.415298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:44.416076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:44.418986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:19:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:44.420495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a480e-414b-476e-a3aa-58ace6b0185e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:44.425853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a480e-414b-476e-a3aa-58ace6b0185e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:44.426400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a480e-414b-476e-a3aa-58ace6b0185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:44.446913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c76a480e-414b-476e-a3aa-58ace6b0185e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:44.448575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c76a480e-414b-476e-a3aa-58ace6b0185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:44.515795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd307a-940f-43d7-b884-71d392c3fa66 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:44.549632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 72/145] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:44.550189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a480e-414b-476e-a3aa-58ace6b0185e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:44.558450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:44.559398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:44.559897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:44.560414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:44.561503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:44.562021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:44.563798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:44.574590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 74/146] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:44.582385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:44.697564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022d8f4-311d-4176-b5fa-f24c0a9ea440 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:44.699817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:44.734248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:44.754408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40235ac-d523-4077-b588-1f8cc18a5ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:44.755061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40235ac-d523-4077-b588-1f8cc18a5ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:44.755351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40235ac-d523-4077-b588-1f8cc18a5ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:44.755683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40235ac-d523-4077-b588-1f8cc18a5ae3 None admin] PATH_INFO: `/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:44.758737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40235ac-d523-4077-b588-1f8cc18a5ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=83e7a3ec09bb47549d2dc9a48d9658cb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:44.760658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40235ac-d523-4077-b588-1f8cc18a5ae3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:44.762962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 75/147] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:44 2022] GET /identity/v3/users/83e7a3ec09bb47549d2dc9a48d9658cb => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:44.769618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40235ac-d523-4077-b588-1f8cc18a5ae3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:44.789166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a480e-414b-476e-a3aa-58ace6b0185e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:44.857805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:44.858486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:44.858733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:44.859003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:44.859673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:44.859974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:44.861407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:44.873258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 73/148] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:19:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:44.880213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:44.936095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40235ac-d523-4077-b588-1f8cc18a5ae3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:44.975639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e59c1-b937-4706-9ae7-9ca20cf47fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:44.976176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e59c1-b937-4706-9ae7-9ca20cf47fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:44.976456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e59c1-b937-4706-9ae7-9ca20cf47fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:44.976732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e59c1-b937-4706-9ae7-9ca20cf47fe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.039234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:45.070723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e59c1-b937-4706-9ae7-9ca20cf47fe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:45.073106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e59c1-b937-4706-9ae7-9ca20cf47fe7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:45.141336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe32da5-e732-41fd-89af-9f4c8b7f90b2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:45.204101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f1d2-4fc3-4580-9f09-999683f6f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:45.204754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f1d2-4fc3-4580-9f09-999683f6f87f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.205850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f1d2-4fc3-4580-9f09-999683f6f87f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.206211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f1d2-4fc3-4580-9f09-999683f6f87f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.209271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24f1d2-4fc3-4580-9f09-999683f6f87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:45.210735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24f1d2-4fc3-4580-9f09-999683f6f87f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:45.212352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 74/149] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:45.213126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f1d2-4fc3-4580-9f09-999683f6f87f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:45.219376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:45.255111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:45.256309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e59c1-b937-4706-9ae7-9ca20cf47fe7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:45.329744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:45.337149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f1d2-4fc3-4580-9f09-999683f6f87f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:45.361000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e59c1-b937-4706-9ae7-9ca20cf47fe7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:45.372358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83620789-5bd2-4752-9b4f-b8f2c5db7e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:45.372995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620789-5bd2-4752-9b4f-b8f2c5db7e12 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.373297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620789-5bd2-4752-9b4f-b8f2c5db7e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.373541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83620789-5bd2-4752-9b4f-b8f2c5db7e12 None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.374686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83620789-5bd2-4752-9b4f-b8f2c5db7e12 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:45.376120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83620789-5bd2-4752-9b4f-b8f2c5db7e12 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:45.378003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 75/151] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:45 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:45.381099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5afc9-4aa1-481f-b5a6-d35f7cf8b104 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.381099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5afc9-4aa1-481f-b5a6-d35f7cf8b104 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.381099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5afc9-4aa1-481f-b5a6-d35f7cf8b104 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.381099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 76/152] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:45.382667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ea82b-f328-424c-9020-1e0cee1a8e94 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.383407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ea82b-f328-424c-9020-1e0cee1a8e94 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.383870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ea82b-f328-424c-9020-1e0cee1a8e94 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.385538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 77/153] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:45.386463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ea82b-f328-424c-9020-1e0cee1a8e94 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:45.405232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb67c6-2b89-4587-8251-077a584d08d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:45.405847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb67c6-2b89-4587-8251-077a584d08d7 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.406189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb67c6-2b89-4587-8251-077a584d08d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.406463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb67c6-2b89-4587-8251-077a584d08d7 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.407113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb67c6-2b89-4587-8251-077a584d08d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:45.409193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb67c6-2b89-4587-8251-077a584d08d7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:45.460046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:45.474097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 77/154] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:19:45 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:45.475430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb67c6-2b89-4587-8251-077a584d08d7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:45.504653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ea82b-f328-424c-9020-1e0cee1a8e94 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:45.545589 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735ef91-3603-43df-9551-156fe221b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:45.546726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735ef91-3603-43df-9551-156fe221b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.547284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735ef91-3603-43df-9551-156fe221b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.547721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735ef91-3603-43df-9551-156fe221b4b8 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.549431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735ef91-3603-43df-9551-156fe221b4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:45.551418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735ef91-3603-43df-9551-156fe221b4b8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:45.558152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 78/155] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:45 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:45.560495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cbb7-9e75-4e28-9213-6d654e422bd4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.560781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cbb7-9e75-4e28-9213-6d654e422bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.561854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692cbb7-9e75-4e28-9213-6d654e422bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.582044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a692cbb7-9e75-4e28-9213-6d654e422bd4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:45.583603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a692cbb7-9e75-4e28-9213-6d654e422bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:45.625400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb67c6-2b89-4587-8251-077a584d08d7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:45.665273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:45.667559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4876cf4-0210-4bca-a2a6-ea80b56aca7d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.667844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4876cf4-0210-4bca-a2a6-ea80b56aca7d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.668113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4876cf4-0210-4bca-a2a6-ea80b56aca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.676659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552b2da-78bb-45ff-834b-74b05b878b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:45.682194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:45.683537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b2da-78bb-45ff-834b-74b05b878b7e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.683920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b2da-78bb-45ff-834b-74b05b878b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.684184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b2da-78bb-45ff-834b-74b05b878b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.690644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e4876cf4-0210-4bca-a2a6-ea80b56aca7d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:45.692581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e4876cf4-0210-4bca-a2a6-ea80b56aca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:45.780489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552b2da-78bb-45ff-834b-74b05b878b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:45.782088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552b2da-78bb-45ff-834b-74b05b878b7e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:45.787832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:45.793653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 80/157] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:45.794990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4876cf4-0210-4bca-a2a6-ea80b56aca7d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:45.926641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 78/158] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:45.928261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261e76-9fa2-4320-9748-99744de0b74d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.929544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261e76-9fa2-4320-9748-99744de0b74d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.930675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35261e76-9fa2-4320-9748-99744de0b74d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:45.933314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 79/159] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:45.934489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35261e76-9fa2-4320-9748-99744de0b74d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:45.944812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4876cf4-0210-4bca-a2a6-ea80b56aca7d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:45.971535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:45.994093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea776c17-4e08-4a53-8e55-d5bfb4c57055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:45.998517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776c17-4e08-4a53-8e55-d5bfb4c57055 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:45.999071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776c17-4e08-4a53-8e55-d5bfb4c57055 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:45.999350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea776c17-4e08-4a53-8e55-d5bfb4c57055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.000100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea776c17-4e08-4a53-8e55-d5bfb4c57055 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=52a1f0f883b14fd1832cf21670c5a803, user.id=83e7a3ec09bb47549d2dc9a48d9658cb) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:46.000408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea776c17-4e08-4a53-8e55-d5bfb4c57055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:46.002654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea776c17-4e08-4a53-8e55-d5bfb4c57055 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:46.009823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 81/160] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:45 2022] GET /identity/v3/role_assignments?user.id=83e7a3ec09bb47549d2dc9a48d9658cb&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:46.011451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3c68-8ef7-4399-ac56-7292518326d7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:46.012442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3c68-8ef7-4399-ac56-7292518326d7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:46.012442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3c68-8ef7-4399-ac56-7292518326d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.041817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-074e3c68-8ef7-4399-ac56-7292518326d7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:46.043430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-074e3c68-8ef7-4399-ac56-7292518326d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:46.071768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35261e76-9fa2-4320-9748-99744de0b74d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:46.119074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f238af-e379-42cb-91e3-b69eb8c69944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:46.120229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f238af-e379-42cb-91e3-b69eb8c69944 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:46.120723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f238af-e379-42cb-91e3-b69eb8c69944 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:46.121293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:46.122628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f238af-e379-42cb-91e3-b69eb8c69944 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.124247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f238af-e379-42cb-91e3-b69eb8c69944 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:46.126030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f238af-e379-42cb-91e3-b69eb8c69944 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:46.128541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 80/161] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:45 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:46.129634 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f238af-e379-42cb-91e3-b69eb8c69944 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:46.133237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 82/162] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:46.136325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3c68-8ef7-4399-ac56-7292518326d7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:46.278415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:46.286478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f238af-e379-42cb-91e3-b69eb8c69944 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:46.301131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3c68-8ef7-4399-ac56-7292518326d7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:46.329471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c325-2c5b-4813-b422-73a921bb3d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:46.330301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c325-2c5b-4813-b422-73a921bb3d61 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:46.330648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c325-2c5b-4813-b422-73a921bb3d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:46.330992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c325-2c5b-4813-b422-73a921bb3d61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.346674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6c325-2c5b-4813-b422-73a921bb3d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b0e6c325-2c5b-4813-b422-73a921bb3d61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:46.351663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:46.352528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:46.353302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:46.354212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:46.354212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:46.354212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:46.354407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 81/163] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:46.354481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.355315 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c325-2c5b-4813-b422-73a921bb3d61 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:46.358241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] RBAC: Adding query filter params (role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=52a1f0f883b14fd1832cf21670c5a803, user.id=4f6db55a18244f29a68c5c078374063f) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:46.358585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:46.365067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:46.374404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 83/164] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:46 2022] GET /identity/v3/role_assignments?user.id=4f6db55a18244f29a68c5c078374063f&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:46.375601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:46.505092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:46.543049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c325-2c5b-4813-b422-73a921bb3d61 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:46.579544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ea09a-8c50-4d69-ba23-838ee2a8a689 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:46.596992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaf259-7b73-4301-a0c9-d0368c1d7811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:46.598159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf259-7b73-4301-a0c9-d0368c1d7811 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:46.598639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf259-7b73-4301-a0c9-d0368c1d7811 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:46.599109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf259-7b73-4301-a0c9-d0368c1d7811 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.622002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaf259-7b73-4301-a0c9-d0368c1d7811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-09aaf259-7b73-4301-a0c9-d0368c1d7811 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:46.628897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:46.630265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:46.631071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:46.631912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:46.631912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:46.631912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:46.631912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.632173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 82/165] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:46.632239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:46.632311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaf259-7b73-4301-a0c9-d0368c1d7811 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:46.632378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:46.634655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:46.645235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 84/166] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:46.646130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:46.658863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:46.790648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaf259-7b73-4301-a0c9-d0368c1d7811 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:46.804080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bc455-c65d-49d8-995e-f7b40964d9a8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:46.834036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:46.850761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598666e4-772c-454b-9708-457304da9f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:46.851467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598666e4-772c-454b-9708-457304da9f8b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:46.851744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598666e4-772c-454b-9708-457304da9f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:46.852015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598666e4-772c-454b-9708-457304da9f8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.854126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:46.854835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:46.855225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:46.855505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:46.856191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:46.856498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:46.857896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:46.869868 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598666e4-772c-454b-9708-457304da9f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:46.872133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 85/167] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:46.872755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-598666e4-772c-454b-9708-457304da9f8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:46.879706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:46.880717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:46.881525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 83/168] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:46.882303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598666e4-772c-454b-9708-457304da9f8b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:46.994509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:47.040715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0b0a3-bb6d-41a5-a0e1-21f341bbca74 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:47.045753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598666e4-772c-454b-9708-457304da9f8b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:47.114759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9565dc6-f381-46c6-a580-a1105636b339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:47.115667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565dc6-f381-46c6-a580-a1105636b339 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:47.115946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565dc6-f381-46c6-a580-a1105636b339 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:47.116217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565dc6-f381-46c6-a580-a1105636b339 None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:47.117520 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9565dc6-f381-46c6-a580-a1105636b339 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:47.118999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9565dc6-f381-46c6-a580-a1105636b339 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:47.120992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 86/169] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:46 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:47.121768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9565dc6-f381-46c6-a580-a1105636b339 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:47.128130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b09ea-ece5-4301-8290-d2193fff8839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:47.128778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b09ea-ece5-4301-8290-d2193fff8839 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:47.129055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b09ea-ece5-4301-8290-d2193fff8839 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:47.129328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b09ea-ece5-4301-8290-d2193fff8839 None admin] PATH_INFO: `/v3/users/4f6db55a18244f29a68c5c078374063f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:47.131480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b09ea-ece5-4301-8290-d2193fff8839 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6db55a18244f29a68c5c078374063f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:47.132935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b09ea-ece5-4301-8290-d2193fff8839 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:47.134597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 84/170] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:46 2022] GET /identity/v3/users/4f6db55a18244f29a68c5c078374063f => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:47.135360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b09ea-ece5-4301-8290-d2193fff8839 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:47.181301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:47.238231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9565dc6-f381-46c6-a580-a1105636b339 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:47.280217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:47.281301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:47.281784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:47.282097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:47.282773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:47.283207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:47.284543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:47.293816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 87/171] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:47.295177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:47.407196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b09ea-ece5-4301-8290-d2193fff8839 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:47.458413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8374c-5f96-4bd0-8027-94bb773eddfa None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:47.474909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:47.479113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3c3d-ef5d-4fd9-9be5-0e23ac8e2167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:47.481519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3c3d-ef5d-4fd9-9be5-0e23ac8e2167 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:47.483208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3c3d-ef5d-4fd9-9be5-0e23ac8e2167 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:47.483655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3c3d-ef5d-4fd9-9be5-0e23ac8e2167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:47.510184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:47.514198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beff949-f6f5-4ea5-8639-c920891da62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:47.515192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff949-f6f5-4ea5-8639-c920891da62e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:47.515676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff949-f6f5-4ea5-8639-c920891da62e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:47.516160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff949-f6f5-4ea5-8639-c920891da62e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:47.608152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff3c3d-ef5d-4fd9-9be5-0e23ac8e2167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:47.610027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff3c3d-ef5d-4fd9-9be5-0e23ac8e2167 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:47.672054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beff949-f6f5-4ea5-8639-c920891da62e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:47.673474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beff949-f6f5-4ea5-8639-c920891da62e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:47.720140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 85/172] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:47.722335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3c3d-ef5d-4fd9-9be5-0e23ac8e2167 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:47.790407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:47.833082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3c3d-ef5d-4fd9-9be5-0e23ac8e2167 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:47.872221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b04f9b-ae25-4cf6-9cd3-5b1a91c31a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:47.873299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04f9b-ae25-4cf6-9cd3-5b1a91c31a6f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:47.873783 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04f9b-ae25-4cf6-9cd3-5b1a91c31a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:47.874284 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b04f9b-ae25-4cf6-9cd3-5b1a91c31a6f None admin] PATH_INFO: `/v3/users/21230ac17b524cbbb6cea41700cdc066` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:47.875756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b04f9b-ae25-4cf6-9cd3-5b1a91c31a6f None admin] RBAC: Authorizing `identity:get_user(user_id=21230ac17b524cbbb6cea41700cdc066)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:47.877698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b04f9b-ae25-4cf6-9cd3-5b1a91c31a6f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:47.879805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 86/173] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:47 2022] GET /identity/v3/users/21230ac17b524cbbb6cea41700cdc066 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:47.880886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b04f9b-ae25-4cf6-9cd3-5b1a91c31a6f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:47.949718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 88/174] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:47.950543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beff949-f6f5-4ea5-8639-c920891da62e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:47.969825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:48.049445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b04f9b-ae25-4cf6-9cd3-5b1a91c31a6f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:48.075353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:48.111553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beff949-f6f5-4ea5-8639-c920891da62e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:48.115478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5198cbb-2780-4d5f-8da3-339806c5b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:48.116114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5198cbb-2780-4d5f-8da3-339806c5b85a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:48.116391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5198cbb-2780-4d5f-8da3-339806c5b85a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:48.116660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5198cbb-2780-4d5f-8da3-339806c5b85a None admin] PATH_INFO: `/v3/projects/462b13bf9b0d4c21b547ba0494f01884` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:48.118421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5198cbb-2780-4d5f-8da3-339806c5b85a None admin] RBAC: Authorizing `identity:get_project(project_id=462b13bf9b0d4c21b547ba0494f01884)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:48.119872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5198cbb-2780-4d5f-8da3-339806c5b85a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:48.127300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 87/175] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:47 2022] GET /identity/v3/projects/462b13bf9b0d4c21b547ba0494f01884 => generated 312 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:48.128334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5198cbb-2780-4d5f-8da3-339806c5b85a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:48.177770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d108e-14be-473b-a440-a6c76e51ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:48.178438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d108e-14be-473b-a440-a6c76e51ed69 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:48.178712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d108e-14be-473b-a440-a6c76e51ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:48.178980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d108e-14be-473b-a440-a6c76e51ed69 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:48.182357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d108e-14be-473b-a440-a6c76e51ed69 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:48.183805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d108e-14be-473b-a440-a6c76e51ed69 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:48.185446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 89/176] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:47 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:48.186240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d108e-14be-473b-a440-a6c76e51ed69 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:48.322162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:48.335865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5198cbb-2780-4d5f-8da3-339806c5b85a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:48.386873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d108e-14be-473b-a440-a6c76e51ed69 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:48.390576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c2b92-68f9-4cfb-a9b4-5c482ed29316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:48.391463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c2b92-68f9-4cfb-a9b4-5c482ed29316 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:48.392910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c2b92-68f9-4cfb-a9b4-5c482ed29316 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:48.393404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c2b92-68f9-4cfb-a9b4-5c482ed29316 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:48.398709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c2b92-68f9-4cfb-a9b4-5c482ed29316 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:48.400171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c2b92-68f9-4cfb-a9b4-5c482ed29316 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:48.401822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 88/177] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:48 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:48.402601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c2b92-68f9-4cfb-a9b4-5c482ed29316 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:48.463909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:48.464538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:48.464812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:48.465080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:48.465821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] RBAC: Adding query filter params (role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=462b13bf9b0d4c21b547ba0494f01884, user.id=4f6db55a18244f29a68c5c078374063f) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:48.466150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:48.468111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:48.489409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:48.489626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 90/178] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:48 2022] GET /identity/v3/role_assignments?user.id=4f6db55a18244f29a68c5c078374063f&scope.project.id=462b13bf9b0d4c21b547ba0494f01884&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:48.490406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:48.582508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c2b92-68f9-4cfb-a9b4-5c482ed29316 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:48.634849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a62ad8-05c6-432d-b2b1-459ea5e149f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:48.635990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62ad8-05c6-432d-b2b1-459ea5e149f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:48.636500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62ad8-05c6-432d-b2b1-459ea5e149f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:48.636980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62ad8-05c6-432d-b2b1-459ea5e149f4 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803/users/21230ac17b524cbbb6cea41700cdc066/roles/b79d313a30ab46dca3bc5d0b3caca61a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:48.639323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a62ad8-05c6-432d-b2b1-459ea5e149f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1f0f883b14fd1832cf21670c5a803, user_id=21230ac17b524cbbb6cea41700cdc066, role_id=b79d313a30ab46dca3bc5d0b3caca61a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:48.641323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a62ad8-05c6-432d-b2b1-459ea5e149f4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:48.692906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237d1bf-9495-4875-8b1d-d30ea6ac08aa None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:48.713847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 89/179] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:19:48 2022] PUT /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803/users/21230ac17b524cbbb6cea41700cdc066/roles/b79d313a30ab46dca3bc5d0b3caca61a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:19:48.716245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a733-89d7-4268-ad65-823e3eb431e1 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:48.716951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a733-89d7-4268-ad65-823e3eb431e1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:48.717401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a733-89d7-4268-ad65-823e3eb431e1 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:48.719082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 90/180] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:48.726064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e3fa-2f3e-490f-8bb9-c223600b9033 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:48.727324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e3fa-2f3e-490f-8bb9-c223600b9033 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:48.727805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e3fa-2f3e-490f-8bb9-c223600b9033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:48.759817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35ff0-cd0d-48fb-b4a0-6573306849a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:48.762874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35ff0-cd0d-48fb-b4a0-6573306849a1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:48.762874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35ff0-cd0d-48fb-b4a0-6573306849a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:48.762874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35ff0-cd0d-48fb-b4a0-6573306849a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:48.762874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35ff0-cd0d-48fb-b4a0-6573306849a1 None admin] RBAC: Adding query filter params (role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=52a1f0f883b14fd1832cf21670c5a803, user.id=4f6db55a18244f29a68c5c078374063f) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:48.762874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35ff0-cd0d-48fb-b4a0-6573306849a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:48.764736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35ff0-cd0d-48fb-b4a0-6573306849a1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:48.770700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a689e3fa-2f3e-490f-8bb9-c223600b9033 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:48.773899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a689e3fa-2f3e-490f-8bb9-c223600b9033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:48.782730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 91/181] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:48 2022] GET /identity/v3/role_assignments?user.id=4f6db55a18244f29a68c5c078374063f&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:48.881135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:49.089171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de3cb-8a1f-4761-88d2-69dd09fd42c6 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.089550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de3cb-8a1f-4761-88d2-69dd09fd42c6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.089739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6de3cb-8a1f-4761-88d2-69dd09fd42c6 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.091103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 92/183] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:49.097202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f6bf-0dec-4c5e-b724-d14e37a40f8d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.097774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f6bf-0dec-4c5e-b724-d14e37a40f8d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.098285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f6bf-0dec-4c5e-b724-d14e37a40f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.120527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1d72f6bf-0dec-4c5e-b724-d14e37a40f8d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:49.122090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1d72f6bf-0dec-4c5e-b724-d14e37a40f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:49.155642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:49.206351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 92/184] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:49.248924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6de3cb-8a1f-4761-88d2-69dd09fd42c6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:49.260069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:49.360164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6de3cb-8a1f-4761-88d2-69dd09fd42c6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:49.374567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f34d1-02ef-45b9-9f63-b300b17fc2b8 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.375323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f34d1-02ef-45b9-9f63-b300b17fc2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.375939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f34d1-02ef-45b9-9f63-b300b17fc2b8 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.378435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 93/185] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:49.384564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532d0b-3004-4d2d-a48c-964211bff48d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.385624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532d0b-3004-4d2d-a48c-964211bff48d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.386162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532d0b-3004-4d2d-a48c-964211bff48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.399970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020744b-d348-4009-a9d2-649c098addf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:49.400606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020744b-d348-4009-a9d2-649c098addf9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.400885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020744b-d348-4009-a9d2-649c098addf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.401159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020744b-d348-4009-a9d2-649c098addf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.408863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b1532d0b-3004-4d2d-a48c-964211bff48d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:49.410473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b1532d0b-3004-4d2d-a48c-964211bff48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:49.412280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020744b-d348-4009-a9d2-649c098addf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-5020744b-d348-4009-a9d2-649c098addf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:49.418425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:49.419339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:49.420736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 93/186] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:49.425940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020744b-d348-4009-a9d2-649c098addf9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:49.496485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:49.507008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 94/187] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:49.507008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532d0b-3004-4d2d-a48c-964211bff48d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:49.547160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020744b-d348-4009-a9d2-649c098addf9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:49.585168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:49.585782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.586080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.586457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.587220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:49.587683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:49.589227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:49.598687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 94/188] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:49.605418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:49.621637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:49.625739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532d0b-3004-4d2d-a48c-964211bff48d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:49.666269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861051d7-ff53-4d1e-a98b-d23dfe8fed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:49.667363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861051d7-ff53-4d1e-a98b-d23dfe8fed53 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.668989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861051d7-ff53-4d1e-a98b-d23dfe8fed53 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.669268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861051d7-ff53-4d1e-a98b-d23dfe8fed53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.689234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861051d7-ff53-4d1e-a98b-d23dfe8fed53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-861051d7-ff53-4d1e-a98b-d23dfe8fed53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:49.696742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:49.697689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:49.698527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:49.705828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 95/189] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:19:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:49.706976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861051d7-ff53-4d1e-a98b-d23dfe8fed53 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:49.743028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098e779-88ca-493b-b8d8-5bb08f4d674a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:49.779808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:49.790469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7117-0cb8-463d-8cca-e09daa0357ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:49.791257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7117-0cb8-463d-8cca-e09daa0357ff None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.791542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7117-0cb8-463d-8cca-e09daa0357ff None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.791821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b7117-0cb8-463d-8cca-e09daa0357ff None admin] PATH_INFO: `/v3/users/af92443031924e978f97f22b9e085274` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.806672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b7117-0cb8-463d-8cca-e09daa0357ff None admin] RBAC: Authorizing `identity:get_user(user_id=af92443031924e978f97f22b9e085274)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:49.808811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b7117-0cb8-463d-8cca-e09daa0357ff None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:49.810996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 95/190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:49 2022] GET /identity/v3/users/af92443031924e978f97f22b9e085274 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:49.812243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7117-0cb8-463d-8cca-e09daa0357ff None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:49.835704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861051d7-ff53-4d1e-a98b-d23dfe8fed53 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:49.871969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:49.873134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.873134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.873134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.873739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:49.874067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:49.875433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:49.883667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 96/191] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:19:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:49.884878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:49.910381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:49.928026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b7117-0cb8-463d-8cca-e09daa0357ff None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:49.963403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da29c76-de96-41d0-ace8-02b97ebdf0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:49.964279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da29c76-de96-41d0-ace8-02b97ebdf0fd None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:49.964711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da29c76-de96-41d0-ace8-02b97ebdf0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:49.965126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da29c76-de96-41d0-ace8-02b97ebdf0fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:49.966419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da29c76-de96-41d0-ace8-02b97ebdf0fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:49.968008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da29c76-de96-41d0-ace8-02b97ebdf0fd None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:49.969801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 96/192] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:49.975701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da29c76-de96-41d0-ace8-02b97ebdf0fd None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:49.995070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc89e-47b8-4cc0-8449-74108e285c47 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:50.032560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa682e-df38-49f4-bb57-403abeeee433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:50.033906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa682e-df38-49f4-bb57-403abeeee433 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:50.034492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa682e-df38-49f4-bb57-403abeeee433 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:50.034768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa682e-df38-49f4-bb57-403abeeee433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:50.037100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:50.082399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da29c76-de96-41d0-ace8-02b97ebdf0fd None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:50.111056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa682e-df38-49f4-bb57-403abeeee433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:50.112596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa682e-df38-49f4-bb57-403abeeee433 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:50.119016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f66f6-5a6b-44a9-a54a-efb1b473c003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:50.119656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f66f6-5a6b-44a9-a54a-efb1b473c003 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:50.119928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f66f6-5a6b-44a9-a54a-efb1b473c003 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:50.120660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f66f6-5a6b-44a9-a54a-efb1b473c003 None admin] PATH_INFO: `/v3/users/af92443031924e978f97f22b9e085274` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:50.121829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f66f6-5a6b-44a9-a54a-efb1b473c003 None admin] RBAC: Authorizing `identity:get_user(user_id=af92443031924e978f97f22b9e085274)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:50.124028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f66f6-5a6b-44a9-a54a-efb1b473c003 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:50.125791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 97/193] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:49 2022] GET /identity/v3/users/af92443031924e978f97f22b9e085274 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:50.126720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f66f6-5a6b-44a9-a54a-efb1b473c003 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:50.134291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:50.225718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 97/194] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:50.225718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa682e-df38-49f4-bb57-403abeeee433 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:50.236751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f66f6-5a6b-44a9-a54a-efb1b473c003 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:50.264535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:50.277233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319cbce-1156-4fb4-838c-db5e759026d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:50.277938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319cbce-1156-4fb4-838c-db5e759026d3 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:50.278251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319cbce-1156-4fb4-838c-db5e759026d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:50.278523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319cbce-1156-4fb4-838c-db5e759026d3 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:50.279178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319cbce-1156-4fb4-838c-db5e759026d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:50.280624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319cbce-1156-4fb4-838c-db5e759026d3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:50.328879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa682e-df38-49f4-bb57-403abeeee433 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:50.350423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:50.365033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1430b8-3bc6-4bbb-ac04-3994a7188d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:50.370247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 98/195] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:19:50 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:19:50.370448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1430b8-3bc6-4bbb-ac04-3994a7188d01 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:50.370448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1430b8-3bc6-4bbb-ac04-3994a7188d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:50.370448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1430b8-3bc6-4bbb-ac04-3994a7188d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:50.370667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319cbce-1156-4fb4-838c-db5e759026d3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:50.480688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1430b8-3bc6-4bbb-ac04-3994a7188d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:50.481881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1430b8-3bc6-4bbb-ac04-3994a7188d01 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:50.521143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319cbce-1156-4fb4-838c-db5e759026d3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:50.570903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79343172-f78c-4027-be7b-dc87287705d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:50.571798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79343172-f78c-4027-be7b-dc87287705d4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:50.572078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79343172-f78c-4027-be7b-dc87287705d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:50.572351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79343172-f78c-4027-be7b-dc87287705d4 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:50.574047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79343172-f78c-4027-be7b-dc87287705d4 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:50.575506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79343172-f78c-4027-be7b-dc87287705d4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:50.577309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 99/196] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:50 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:50.583627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79343172-f78c-4027-be7b-dc87287705d4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:50.607411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 98/197] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:50.613884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1430b8-3bc6-4bbb-ac04-3994a7188d01 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:50.637520 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:50.638235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:50.704542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79343172-f78c-4027-be7b-dc87287705d4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:50.747920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1430b8-3bc6-4bbb-ac04-3994a7188d01 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:50.759333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:50.759968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:50.760248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:50.760525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:50.761274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=51900785ee9d499d9709cae42cfc5db2, user.id=af92443031924e978f97f22b9e085274) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:50.761584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:50.763127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:50.774047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 100/198] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:50 2022] GET /identity/v3/role_assignments?user.id=af92443031924e978f97f22b9e085274&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:50.801723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d69a0b-1a13-4592-bf0f-c23d4e48d5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:50.802413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d69a0b-1a13-4592-bf0f-c23d4e48d5df None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:50.802691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d69a0b-1a13-4592-bf0f-c23d4e48d5df None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:50.802967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d69a0b-1a13-4592-bf0f-c23d4e48d5df None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:50.804210 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d69a0b-1a13-4592-bf0f-c23d4e48d5df None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:50.805714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d69a0b-1a13-4592-bf0f-c23d4e48d5df None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:50.807511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 99/199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:50 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:50.814730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:50.946704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b202-ea62-4e38-99b1-25e1e130353e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:50.959051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:50.985518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f69e9-65f4-4d87-87fb-f0c1ee1192c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:50.987269 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f69e9-65f4-4d87-87fb-f0c1ee1192c6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:50.987694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f69e9-65f4-4d87-87fb-f0c1ee1192c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:50.988105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f69e9-65f4-4d87-87fb-f0c1ee1192c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:50.988982 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f69e9-65f4-4d87-87fb-f0c1ee1192c6 None admin] RBAC: Adding query filter params (role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=51900785ee9d499d9709cae42cfc5db2, user.id=af92443031924e978f97f22b9e085274) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:50.989432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f69e9-65f4-4d87-87fb-f0c1ee1192c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:50.991120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f69e9-65f4-4d87-87fb-f0c1ee1192c6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:50.997550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 101/200] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:50 2022] GET /identity/v3/role_assignments?user.id=af92443031924e978f97f22b9e085274&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:51.184536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc723-5589-45c3-80dd-93738da72f8d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:51.185024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc723-5589-45c3-80dd-93738da72f8d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:51.185024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc723-5589-45c3-80dd-93738da72f8d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:51.186501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 100/201] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:51.192466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf3a1-6b67-4048-afc5-c90016a33c7f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:51.193080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf3a1-6b67-4048-afc5-c90016a33c7f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:51.193629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf3a1-6b67-4048-afc5-c90016a33c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:51.213571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-52ebf3a1-6b67-4048-afc5-c90016a33c7f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:51.215220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-52ebf3a1-6b67-4048-afc5-c90016a33c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:51.300299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 102/202] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:51.719697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc723-5589-45c3-80dd-93738da72f8d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:51.828693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:51.847417 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc723-5589-45c3-80dd-93738da72f8d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:51.901267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3be41-1da0-4146-8ad4-6477ffaec9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:51.902285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3be41-1da0-4146-8ad4-6477ffaec9ae None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:51.902787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3be41-1da0-4146-8ad4-6477ffaec9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:51.903335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3be41-1da0-4146-8ad4-6477ffaec9ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:51.922586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3be41-1da0-4146-8ad4-6477ffaec9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0cf3be41-1da0-4146-8ad4-6477ffaec9ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:51.929683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:51.930706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:19:51.931524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:51.938544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 101/203] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:51.943960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebf3a1-6b67-4048-afc5-c90016a33c7f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:52.079115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebf3a1-6b67-4048-afc5-c90016a33c7f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:52.082932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:52.129037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:52.130046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:52.130545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:52.131054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:52.131945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:52.132446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:52.134055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:52.143567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:52.149312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3be41-1da0-4146-8ad4-6477ffaec9ae None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:52.280095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3be41-1da0-4146-8ad4-6477ffaec9ae None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:52.334208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9251a-1e94-4682-8808-074d4a66cbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:52.335172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9251a-1e94-4682-8808-074d4a66cbba None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:52.335646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9251a-1e94-4682-8808-074d4a66cbba None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:52.336105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9251a-1e94-4682-8808-074d4a66cbba None admin] PATH_INFO: `/v3/users/21230ac17b524cbbb6cea41700cdc066` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:52.342830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9251a-1e94-4682-8808-074d4a66cbba None admin] RBAC: Authorizing `identity:get_user(user_id=21230ac17b524cbbb6cea41700cdc066)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:52.344511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9251a-1e94-4682-8808-074d4a66cbba None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:52.346781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 102/205] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:52 2022] GET /identity/v3/users/21230ac17b524cbbb6cea41700cdc066 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:52.352003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:52.512131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41db37-f513-4cf9-9acb-a474a5197c34 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:52.558275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b65512-394c-4bc6-91ba-77e378b4b11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:52.558891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b65512-394c-4bc6-91ba-77e378b4b11f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:52.559173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b65512-394c-4bc6-91ba-77e378b4b11f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:52.559450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b65512-394c-4bc6-91ba-77e378b4b11f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:52.614410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:52.651831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b65512-394c-4bc6-91ba-77e378b4b11f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:52.653382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b65512-394c-4bc6-91ba-77e378b4b11f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:52.793246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 104/206] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:52.799211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9251a-1e94-4682-8808-074d4a66cbba None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:52.834113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:52.967820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9251a-1e94-4682-8808-074d4a66cbba None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:53.019841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5cb98-028c-49f6-ba83-dc07af1fca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:53.020498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5cb98-028c-49f6-ba83-dc07af1fca75 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.020775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5cb98-028c-49f6-ba83-dc07af1fca75 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.021049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5cb98-028c-49f6-ba83-dc07af1fca75 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.022300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5cb98-028c-49f6-ba83-dc07af1fca75 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:53.023778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5cb98-028c-49f6-ba83-dc07af1fca75 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:53.025851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 103/207] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:52 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:53.031745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b65512-394c-4bc6-91ba-77e378b4b11f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:53.138808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:53.165008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf64b1-6a1d-4889-9c19-59c2b45a5171 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.165656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf64b1-6a1d-4889-9c19-59c2b45a5171 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.166162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf64b1-6a1d-4889-9c19-59c2b45a5171 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.169127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 104/208] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:19:53.175415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ef2f-4800-447f-8428-ea18d6c9b806 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.175932 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ef2f-4800-447f-8428-ea18d6c9b806 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.176378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ef2f-4800-447f-8428-ea18d6c9b806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.193700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b65512-394c-4bc6-91ba-77e378b4b11f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:53.205909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-dee2ef2f-4800-447f-8428-ea18d6c9b806 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:53.209059 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dee2ef2f-4800-447f-8428-ea18d6c9b806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:53.266577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafbcbe-056e-49eb-9cd4-b82b6e1abffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:53.267224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafbcbe-056e-49eb-9cd4-b82b6e1abffe None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.267499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafbcbe-056e-49eb-9cd4-b82b6e1abffe None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.267771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafbcbe-056e-49eb-9cd4-b82b6e1abffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.268498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafbcbe-056e-49eb-9cd4-b82b6e1abffe None admin] RBAC: Adding query filter params (role.id=b79d313a30ab46dca3bc5d0b3caca61a, scope.project.id=52a1f0f883b14fd1832cf21670c5a803, user.id=21230ac17b524cbbb6cea41700cdc066) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:53.268800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafbcbe-056e-49eb-9cd4-b82b6e1abffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:53.270254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafbcbe-056e-49eb-9cd4-b82b6e1abffe None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:53.278307 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 105/209] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:53 2022] GET /identity/v3/role_assignments?user.id=21230ac17b524cbbb6cea41700cdc066&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=b79d313a30ab46dca3bc5d0b3caca61a => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:53.348098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 105/210] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:53.466622 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb791c-52df-49ec-8c9a-ebf29b3c40d9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.466942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb791c-52df-49ec-8c9a-ebf29b3c40d9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.467169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb791c-52df-49ec-8c9a-ebf29b3c40d9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.468794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 106/211] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:53.474167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4fda-561f-46e0-986c-88499f3a955f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.474450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4fda-561f-46e0-986c-88499f3a955f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.474724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4fda-561f-46e0-986c-88499f3a955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.503228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-716a4fda-561f-46e0-986c-88499f3a955f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:53.504358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-716a4fda-561f-46e0-986c-88499f3a955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:53.515276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:53.589812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 106/212] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:53.647546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7f5d-57f6-418c-a286-c2c7073ce649 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.647898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7f5d-57f6-418c-a286-c2c7073ce649 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.648094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7f5d-57f6-418c-a286-c2c7073ce649 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.650071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 107/213] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:53.656254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0cee-b45c-4a79-9c70-c002806f758c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.656565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0cee-b45c-4a79-9c70-c002806f758c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.656807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0cee-b45c-4a79-9c70-c002806f758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.682594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c7fe0cee-b45c-4a79-9c70-c002806f758c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:53.683814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c7fe0cee-b45c-4a79-9c70-c002806f758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:53.734821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b7f5d-57f6-418c-a286-c2c7073ce649 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:53.786537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 107/214] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:53.788114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d3ea-fd45-4a1e-bd1c-8f8c8ca54ba7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.788617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d3ea-fd45-4a1e-bd1c-8f8c8ca54ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.789662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324d3ea-fd45-4a1e-bd1c-8f8c8ca54ba7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.791748 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 108/215] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:53.799223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62818a3-abd0-485f-82bd-1e8abc47e5b9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.799223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62818a3-abd0-485f-82bd-1e8abc47e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.799223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62818a3-abd0-485f-82bd-1e8abc47e5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.816449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d62818a3-abd0-485f-82bd-1e8abc47e5b9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:53.817840 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d62818a3-abd0-485f-82bd-1e8abc47e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:53.865368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b7f5d-57f6-418c-a286-c2c7073ce649 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:53.898114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:53.900822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 109/216] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:19:53.907454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62818a3-abd0-485f-82bd-1e8abc47e5b9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:53.912276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:53.913194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186d388-ba84-48f8-b88b-5a050a44cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:53.913872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186d388-ba84-48f8-b88b-5a050a44cc41 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:53.918764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186d388-ba84-48f8-b88b-5a050a44cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:53.919043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186d388-ba84-48f8-b88b-5a050a44cc41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:53.920577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186d388-ba84-48f8-b88b-5a050a44cc41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:53.923914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186d388-ba84-48f8-b88b-5a050a44cc41 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:53.926537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 108/217] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:53.931000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186d388-ba84-48f8-b88b-5a050a44cc41 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.032360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62818a3-abd0-485f-82bd-1e8abc47e5b9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.051048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186d388-ba84-48f8-b88b-5a050a44cc41 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.073944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84c4f0-006e-4c4a-91fb-356163e54515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.074600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c4f0-006e-4c4a-91fb-356163e54515 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.074896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c4f0-006e-4c4a-91fb-356163e54515 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.075165 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84c4f0-006e-4c4a-91fb-356163e54515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.085309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84c4f0-006e-4c4a-91fb-356163e54515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:54.087948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586f3cc-d984-4029-941a-0ca27f28df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.088555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f3cc-d984-4029-941a-0ca27f28df24 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.088830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f3cc-d984-4029-941a-0ca27f28df24 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.089097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f3cc-d984-4029-941a-0ca27f28df24 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.089739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586f3cc-d984-4029-941a-0ca27f28df24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2c84c4f0-006e-4c4a-91fb-356163e54515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:54.090267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:54.091130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:54.092004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:54.092605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586f3cc-d984-4029-941a-0ca27f28df24 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:54.092680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 110/218] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:54.097463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84c4f0-006e-4c4a-91fb-356163e54515 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.159655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:54.180642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 109/219] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:19:53 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:19:54.186035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586f3cc-d984-4029-941a-0ca27f28df24 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.199788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84c4f0-006e-4c4a-91fb-356163e54515 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.251148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad1c4e-289c-4e37-a248-7433c23b76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.252591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1c4e-289c-4e37-a248-7433c23b76b9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.252889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1c4e-289c-4e37-a248-7433c23b76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.253132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1c4e-289c-4e37-a248-7433c23b76b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.254012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:54.265045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad1c4e-289c-4e37-a248-7433c23b76b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-bdad1c4e-289c-4e37-a248-7433c23b76b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:54.270233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:54.271196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:54.271998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 111/220] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:54.274924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad1c4e-289c-4e37-a248-7433c23b76b9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.310658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586f3cc-d984-4029-941a-0ca27f28df24 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.348820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38546338-f653-4423-a457-3a4945e56349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.349445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38546338-f653-4423-a457-3a4945e56349 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.349721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38546338-f653-4423-a457-3a4945e56349 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.350117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38546338-f653-4423-a457-3a4945e56349 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.350788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38546338-f653-4423-a457-3a4945e56349 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:54.351089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38546338-f653-4423-a457-3a4945e56349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:54.352486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38546338-f653-4423-a457-3a4945e56349 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:54.364488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 110/221] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:54.364488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38546338-f653-4423-a457-3a4945e56349 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.400852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad1c4e-289c-4e37-a248-7433c23b76b9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.427654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:54.440140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a8e71-570d-4d04-807c-e99d7a9539d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.440777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a8e71-570d-4d04-807c-e99d7a9539d8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.443775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a8e71-570d-4d04-807c-e99d7a9539d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.443775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a8e71-570d-4d04-807c-e99d7a9539d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.458614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a8e71-570d-4d04-807c-e99d7a9539d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b14a8e71-570d-4d04-807c-e99d7a9539d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:54.463337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:54.464242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:54.465080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 112/222] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:54.465763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a8e71-570d-4d04-807c-e99d7a9539d8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.490229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38546338-f653-4423-a457-3a4945e56349 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.510923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:54.531268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.531891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.534198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.534198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.534198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:54.534198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:54.535040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:54.545911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 111/223] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:54.546771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.593273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a8e71-570d-4d04-807c-e99d7a9539d8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.639397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a8437-ee97-4465-b287-78ac96efb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.640026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8437-ee97-4465-b287-78ac96efb773 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.640303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8437-ee97-4465-b287-78ac96efb773 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.640571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8437-ee97-4465-b287-78ac96efb773 None admin] PATH_INFO: `/v3/users/af92443031924e978f97f22b9e085274` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.641716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a8437-ee97-4465-b287-78ac96efb773 None admin] RBAC: Authorizing `identity:get_user(user_id=af92443031924e978f97f22b9e085274)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:54.644025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a8437-ee97-4465-b287-78ac96efb773 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:54.646521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 113/224] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/users/af92443031924e978f97f22b9e085274 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:54.651566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a8437-ee97-4465-b287-78ac96efb773 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.681580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f27703-2e2d-4ca1-910a-72268f552ecc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.711849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:54.729447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e32c2-4478-48e2-8824-20da698520db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.730095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e32c2-4478-48e2-8824-20da698520db None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.730375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e32c2-4478-48e2-8824-20da698520db None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.730672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e32c2-4478-48e2-8824-20da698520db None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.731466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e32c2-4478-48e2-8824-20da698520db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:54.732541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e32c2-4478-48e2-8824-20da698520db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:54.734097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e32c2-4478-48e2-8824-20da698520db None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:54.743597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 112/225] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:54.745459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e32c2-4478-48e2-8824-20da698520db None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.771929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a8437-ee97-4465-b287-78ac96efb773 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.806140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:54.811206 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e24b9c-440f-4629-af41-76e877f4169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.812105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24b9c-440f-4629-af41-76e877f4169e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.812582 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24b9c-440f-4629-af41-76e877f4169e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.813065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e24b9c-440f-4629-af41-76e877f4169e None admin] PATH_INFO: `/v3/users/cd22dc76de994cdab0bbaa4d12a3f91e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.828032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e24b9c-440f-4629-af41-76e877f4169e None admin] RBAC: Authorizing `identity:get_user(user_id=cd22dc76de994cdab0bbaa4d12a3f91e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:54.829994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e24b9c-440f-4629-af41-76e877f4169e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:54.833397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 114/226] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/users/cd22dc76de994cdab0bbaa4d12a3f91e => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:54.834207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e24b9c-440f-4629-af41-76e877f4169e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.894708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e32c2-4478-48e2-8824-20da698520db None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.941772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bbfb0-ec58-474f-922d-9e184722355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.942855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bbfb0-ec58-474f-922d-9e184722355a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.943140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bbfb0-ec58-474f-922d-9e184722355a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.943681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bbfb0-ec58-474f-922d-9e184722355a None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.945105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bbfb0-ec58-474f-922d-9e184722355a None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:54.947289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bbfb0-ec58-474f-922d-9e184722355a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:54.948282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e24b9c-440f-4629-af41-76e877f4169e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:54.948918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 113/227] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:54.949702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bbfb0-ec58-474f-922d-9e184722355a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:54.965920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:54.992286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5938802-12d1-4052-9b05-1320075f85a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:54.992926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938802-12d1-4052-9b05-1320075f85a4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:54.993203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938802-12d1-4052-9b05-1320075f85a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:54.993476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5938802-12d1-4052-9b05-1320075f85a4 None admin] PATH_INFO: `/v3/users/af92443031924e978f97f22b9e085274` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:54.994640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5938802-12d1-4052-9b05-1320075f85a4 None admin] RBAC: Authorizing `identity:get_user(user_id=af92443031924e978f97f22b9e085274)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:54.996272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5938802-12d1-4052-9b05-1320075f85a4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:54.998306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 115/228] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/users/af92443031924e978f97f22b9e085274 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:54.998863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5938802-12d1-4052-9b05-1320075f85a4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:55.087110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bbfb0-ec58-474f-922d-9e184722355a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:55.099666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:55.124626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5938802-12d1-4052-9b05-1320075f85a4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:55.131327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97078-9f4a-4dd2-a229-a3babf4af559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:55.131948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97078-9f4a-4dd2-a229-a3babf4af559 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:55.132227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97078-9f4a-4dd2-a229-a3babf4af559 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:55.132498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba97078-9f4a-4dd2-a229-a3babf4af559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:55.163770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b9fd4-71a7-4a06-ac23-59f064087d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:55.164358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b9fd4-71a7-4a06-ac23-59f064087d99 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:55.164639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b9fd4-71a7-4a06-ac23-59f064087d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:55.164917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b9fd4-71a7-4a06-ac23-59f064087d99 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2/users/af92443031924e978f97f22b9e085274/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:55.166986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b9fd4-71a7-4a06-ac23-59f064087d99 None admin] RBAC: Authorizing `identity:create_grant(project_id=51900785ee9d499d9709cae42cfc5db2, user_id=af92443031924e978f97f22b9e085274, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:55.168526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b9fd4-71a7-4a06-ac23-59f064087d99 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:55.210091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97078-9f4a-4dd2-a229-a3babf4af559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:55.211547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba97078-9f4a-4dd2-a229-a3babf4af559 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:55.246554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 116/229] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:19:54 2022] PUT /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2/users/af92443031924e978f97f22b9e085274/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:19:55.249524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b9fd4-71a7-4a06-ac23-59f064087d99 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:55.324718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:55.413621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 114/230] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:19:55.424273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b9fd4-71a7-4a06-ac23-59f064087d99 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:55.427709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97078-9f4a-4dd2-a229-a3babf4af559 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:55.446861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:55.463724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a71107-c33a-4157-8804-b76e3ffc9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:55.464356 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a71107-c33a-4157-8804-b76e3ffc9eeb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:55.464645 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a71107-c33a-4157-8804-b76e3ffc9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:55.464957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a71107-c33a-4157-8804-b76e3ffc9eeb None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:55.467483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a71107-c33a-4157-8804-b76e3ffc9eeb None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:55.468964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a71107-c33a-4157-8804-b76e3ffc9eeb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:55.471677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 117/231] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:55 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:55.478384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a71107-c33a-4157-8804-b76e3ffc9eeb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:55.578617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba97078-9f4a-4dd2-a229-a3babf4af559 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:55.615536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2f704-6923-4150-8f7f-bf86c5ba8e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:55.616174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2f704-6923-4150-8f7f-bf86c5ba8e8d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:55.616449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2f704-6923-4150-8f7f-bf86c5ba8e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:55.616717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2f704-6923-4150-8f7f-bf86c5ba8e8d None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:55.617902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2f704-6923-4150-8f7f-bf86c5ba8e8d None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:55.619432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2f704-6923-4150-8f7f-bf86c5ba8e8d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:55.621407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 115/232] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:55 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:55.621841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a71107-c33a-4157-8804-b76e3ffc9eeb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:55.627319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2f704-6923-4150-8f7f-bf86c5ba8e8d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:55.639426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:55.691040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004b90b-51eb-48a2-92bd-05acfd95349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:55.691619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b90b-51eb-48a2-92bd-05acfd95349d None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:55.691897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b90b-51eb-48a2-92bd-05acfd95349d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:55.692168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b90b-51eb-48a2-92bd-05acfd95349d None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2/users/af92443031924e978f97f22b9e085274/roles/6ab17e0fb4c647c690842276bdf39eeb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:55.694902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004b90b-51eb-48a2-92bd-05acfd95349d None admin] RBAC: Authorizing `identity:create_grant(project_id=51900785ee9d499d9709cae42cfc5db2, user_id=af92443031924e978f97f22b9e085274, role_id=6ab17e0fb4c647c690842276bdf39eeb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:55.696480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004b90b-51eb-48a2-92bd-05acfd95349d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:55.718545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:55.742050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2f704-6923-4150-8f7f-bf86c5ba8e8d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:55.781796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89095e4d-ca22-4251-bb18-93c083f1d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:55.782884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095e4d-ca22-4251-bb18-93c083f1d84f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:55.783484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095e4d-ca22-4251-bb18-93c083f1d84f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:55.783928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89095e4d-ca22-4251-bb18-93c083f1d84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:55.784866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89095e4d-ca22-4251-bb18-93c083f1d84f None admin] RBAC: Adding query filter params (role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=51900785ee9d499d9709cae42cfc5db2, user.id=cd22dc76de994cdab0bbaa4d12a3f91e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:55.785730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89095e4d-ca22-4251-bb18-93c083f1d84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:55.787717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89095e4d-ca22-4251-bb18-93c083f1d84f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:55.795209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 116/233] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:55 2022] GET /identity/v3/role_assignments?user.id=cd22dc76de994cdab0bbaa4d12a3f91e&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:55.804589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 118/234] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:19:55 2022] PUT /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2/users/af92443031924e978f97f22b9e085274/roles/6ab17e0fb4c647c690842276bdf39eeb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:19:56.738667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8341786-5ecb-4c90-b063-cf9fd6e45041 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:56.739765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8341786-5ecb-4c90-b063-cf9fd6e45041 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:56.740322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8341786-5ecb-4c90-b063-cf9fd6e45041 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:56.742024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 117/235] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:56.747950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc24f5-8d03-43a5-ad77-27f69306c379 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:56.748828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc24f5-8d03-43a5-ad77-27f69306c379 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:56.749327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc24f5-8d03-43a5-ad77-27f69306c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:56.769189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-eddc24f5-8d03-43a5-ad77-27f69306c379 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:56.770821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-eddc24f5-8d03-43a5-ad77-27f69306c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:56.842997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 119/236] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:56.895902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c57a9-b391-4b38-8423-39a95163b3ba None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:56.896228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c57a9-b391-4b38-8423-39a95163b3ba None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:56.896453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c57a9-b391-4b38-8423-39a95163b3ba None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:56.897946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 118/237] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:56.903181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91cbcc-2049-4be8-b741-55ed731da37f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:56.903685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91cbcc-2049-4be8-b741-55ed731da37f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:56.904165 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91cbcc-2049-4be8-b741-55ed731da37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:56.926833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fc91cbcc-2049-4be8-b741-55ed731da37f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:56.928385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fc91cbcc-2049-4be8-b741-55ed731da37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:57.027359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 120/238] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:57.135388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c57a9-b391-4b38-8423-39a95163b3ba None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:57.278737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c57a9-b391-4b38-8423-39a95163b3ba None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:57.322771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae959-fdf5-43f0-b274-e16c9683e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:57.323407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae959-fdf5-43f0-b274-e16c9683e18a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:57.323684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae959-fdf5-43f0-b274-e16c9683e18a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:57.323960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ae959-fdf5-43f0-b274-e16c9683e18a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:57.334393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:57.338057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ae959-fdf5-43f0-b274-e16c9683e18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-820ae959-fdf5-43f0-b274-e16c9683e18a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:57.343299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:57.344186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:19:57.345098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:57.347687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 119/239] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:57.353784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91cbcc-2049-4be8-b741-55ed731da37f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:57.366010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae959-fdf5-43f0-b274-e16c9683e18a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:57.396587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:57.520963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91cbcc-2049-4be8-b741-55ed731da37f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:57.543298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ae959-fdf5-43f0-b274-e16c9683e18a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:57.560624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:57.561238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:57.561516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:57.561788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:57.563085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:57.563396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:57.565360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:57.575471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 121/240] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:57.590198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:57.621109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc19442-dcdd-4295-87a6-a77e7cf2e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:57.621755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc19442-dcdd-4295-87a6-a77e7cf2e718 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:57.622059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc19442-dcdd-4295-87a6-a77e7cf2e718 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:57.622332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc19442-dcdd-4295-87a6-a77e7cf2e718 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:57.626098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc19442-dcdd-4295-87a6-a77e7cf2e718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:57.628348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc19442-dcdd-4295-87a6-a77e7cf2e718 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:57.629964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 120/241] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:57.636954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc19442-dcdd-4295-87a6-a77e7cf2e718 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:57.770691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:57.774521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:57.786177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1ac7-1021-475e-9937-445b0e8e52fc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:57.830119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f572-5230-4d7f-9ce1-102fc2b1e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:57.830678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f572-5230-4d7f-9ce1-102fc2b1e6ea None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:57.830955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f572-5230-4d7f-9ce1-102fc2b1e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:57.831224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f572-5230-4d7f-9ce1-102fc2b1e6ea None admin] PATH_INFO: `/v3/users/ad81ea9f3a33494c910210749c32e91e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:57.846492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc19442-dcdd-4295-87a6-a77e7cf2e718 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:57.870010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6f572-5230-4d7f-9ce1-102fc2b1e6ea None admin] RBAC: Authorizing `identity:get_user(user_id=ad81ea9f3a33494c910210749c32e91e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:57.870010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6f572-5230-4d7f-9ce1-102fc2b1e6ea None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:57.870010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 122/242] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:57 2022] GET /identity/v3/users/ad81ea9f3a33494c910210749c32e91e => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:57.877197 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f572-5230-4d7f-9ce1-102fc2b1e6ea None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:57.919389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec42d26-d9d0-4b4f-b36b-f7f3b761a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:57.920028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec42d26-d9d0-4b4f-b36b-f7f3b761a9f2 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:57.920309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec42d26-d9d0-4b4f-b36b-f7f3b761a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:57.920583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec42d26-d9d0-4b4f-b36b-f7f3b761a9f2 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:57.921250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec42d26-d9d0-4b4f-b36b-f7f3b761a9f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:57.922765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec42d26-d9d0-4b4f-b36b-f7f3b761a9f2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:58.000664 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f572-5230-4d7f-9ce1-102fc2b1e6ea None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:58.038949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4e7be-962c-475a-8c77-f40a0e365ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:58.039895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4e7be-962c-475a-8c77-f40a0e365ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.040372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4e7be-962c-475a-8c77-f40a0e365ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.040919 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4e7be-962c-475a-8c77-f40a0e365ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.046169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 121/243] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:19:57 2022] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:19:58.049421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb2c7-9eb6-47ed-a605-da2cb41f16c3 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.049708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb2c7-9eb6-47ed-a605-da2cb41f16c3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.050149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb2c7-9eb6-47ed-a605-da2cb41f16c3 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.059172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 122/244] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:58.065948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d653934-74bf-4a64-a889-6f31f6b7c0c4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.072144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d653934-74bf-4a64-a889-6f31f6b7c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.072144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d653934-74bf-4a64-a889-6f31f6b7c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.077503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:58.112652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6d653934-74bf-4a64-a889-6f31f6b7c0c4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:58.114399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6d653934-74bf-4a64-a889-6f31f6b7c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:58.158208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4e7be-962c-475a-8c77-f40a0e365ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:58.160260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4e7be-962c-475a-8c77-f40a0e365ca7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:58.284179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 123/245] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:58.321295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 123/246] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 14:19:58.326940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d653934-74bf-4a64-a889-6f31f6b7c0c4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:58.394195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:58.445704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d653934-74bf-4a64-a889-6f31f6b7c0c4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:58.485339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de313efd-e387-4ae1-aa95-6bcf72d5259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:58.486612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313efd-e387-4ae1-aa95-6bcf72d5259f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.486887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313efd-e387-4ae1-aa95-6bcf72d5259f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.487167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313efd-e387-4ae1-aa95-6bcf72d5259f None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.488282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de313efd-e387-4ae1-aa95-6bcf72d5259f None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:58.489730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de313efd-e387-4ae1-aa95-6bcf72d5259f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:58.491444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 124/247] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:58 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:58.495415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52e85d-d479-444d-bfc1-3b9aabc5c241 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.495703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52e85d-d479-444d-bfc1-3b9aabc5c241 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.495979 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52e85d-d479-444d-bfc1-3b9aabc5c241 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.497789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 124/248] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:58.498740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de313efd-e387-4ae1-aa95-6bcf72d5259f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:58.503351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a378-0a3f-406c-a0c0-647c123e1d4e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.503695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a378-0a3f-406c-a0c0-647c123e1d4e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.503982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255a378-0a3f-406c-a0c0-647c123e1d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.534278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d255a378-0a3f-406c-a0c0-647c123e1d4e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:58.535520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d255a378-0a3f-406c-a0c0-647c123e1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:58.597386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:58.628611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 125/249] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:19:58.632722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a378-0a3f-406c-a0c0-647c123e1d4e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:58.643448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de313efd-e387-4ae1-aa95-6bcf72d5259f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:58.674016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:58.696237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509598e9-7297-4c63-a51f-3ec04a1d2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:58.696859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509598e9-7297-4c63-a51f-3ec04a1d2eeb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.697137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509598e9-7297-4c63-a51f-3ec04a1d2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.697407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509598e9-7297-4c63-a51f-3ec04a1d2eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.698197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509598e9-7297-4c63-a51f-3ec04a1d2eeb None admin] RBAC: Adding query filter params (role.id=b79d313a30ab46dca3bc5d0b3caca61a, scope.project.id=51900785ee9d499d9709cae42cfc5db2, user.id=ad81ea9f3a33494c910210749c32e91e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:58.698503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509598e9-7297-4c63-a51f-3ec04a1d2eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:58.699923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509598e9-7297-4c63-a51f-3ec04a1d2eeb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:58.706481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 125/250] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:19:58 2022] GET /identity/v3/role_assignments?user.id=ad81ea9f3a33494c910210749c32e91e&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=b79d313a30ab46dca3bc5d0b3caca61a => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:58.708148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7673-26f7-45fc-b1c3-bc2d36ff8925 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.708148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7673-26f7-45fc-b1c3-bc2d36ff8925 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.708148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd7673-26f7-45fc-b1c3-bc2d36ff8925 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.709336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 126/251] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:19:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:19:58.718370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25738c-dad4-4d93-8f88-a7e9138269ae None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.718710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25738c-dad4-4d93-8f88-a7e9138269ae None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.718943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25738c-dad4-4d93-8f88-a7e9138269ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.747905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5a25738c-dad4-4d93-8f88-a7e9138269ae None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:19:58.749458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5a25738c-dad4-4d93-8f88-a7e9138269ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:19:58.770619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255a378-0a3f-406c-a0c0-647c123e1d4e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:58.816036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab073e6-94a7-43b4-a091-981257ca13ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:58.816850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab073e6-94a7-43b4-a091-981257ca13ce None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:58.817099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab073e6-94a7-43b4-a091-981257ca13ce None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:58.817258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab073e6-94a7-43b4-a091-981257ca13ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:58.840726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab073e6-94a7-43b4-a091-981257ca13ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3ab073e6-94a7-43b4-a091-981257ca13ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:58.846500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:58.847431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:19:58.848239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 126/252] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:58.856479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab073e6-94a7-43b4-a091-981257ca13ce None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:58.904041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 127/253] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:19:58.934966 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:58.935785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25738c-dad4-4d93-8f88-a7e9138269ae None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:58.998214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab073e6-94a7-43b4-a091-981257ca13ce None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:59.034876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:59.035486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:59.035768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:59.036043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:59.036717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:59.037022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:59.038503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:59.047624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 127/254] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:59.056005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:59.152888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25738c-dad4-4d93-8f88-a7e9138269ae None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:59.165698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641023e4-0176-41e9-ab1c-7b5d24aa4295 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:59.172909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:59.192309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:59.203008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28c593-b74c-4976-80ae-d498a8edb930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:59.203693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28c593-b74c-4976-80ae-d498a8edb930 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:59.203977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28c593-b74c-4976-80ae-d498a8edb930 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:59.204274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28c593-b74c-4976-80ae-d498a8edb930 None admin] PATH_INFO: `/v3/users/af92443031924e978f97f22b9e085274` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:59.205723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28c593-b74c-4976-80ae-d498a8edb930 None admin] RBAC: Authorizing `identity:get_user(user_id=af92443031924e978f97f22b9e085274)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:59.207212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28c593-b74c-4976-80ae-d498a8edb930 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:59.209085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 128/255] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:59 2022] GET /identity/v3/users/af92443031924e978f97f22b9e085274 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:19:59.216309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28c593-b74c-4976-80ae-d498a8edb930 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:59.240817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac1ba1-a1ed-4e65-941a-367b9ea23716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:59.240817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac1ba1-a1ed-4e65-941a-367b9ea23716 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:59.240817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac1ba1-a1ed-4e65-941a-367b9ea23716 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:59.240817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac1ba1-a1ed-4e65-941a-367b9ea23716 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:59.261939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac1ba1-a1ed-4e65-941a-367b9ea23716 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-57ac1ba1-a1ed-4e65-941a-367b9ea23716 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:59.267759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:59.268853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:19:59.269857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:59.272272 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 128/256] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:19:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:59.283277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac1ba1-a1ed-4e65-941a-367b9ea23716 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:59.397707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28c593-b74c-4976-80ae-d498a8edb930 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:59.467724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae30fc2-32da-4f83-9e39-e6e7c7e57e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:59.468251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae30fc2-32da-4f83-9e39-e6e7c7e57e09 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:59.468525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae30fc2-32da-4f83-9e39-e6e7c7e57e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:59.468793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae30fc2-32da-4f83-9e39-e6e7c7e57e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:59.505464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac1ba1-a1ed-4e65-941a-367b9ea23716 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:59.521821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:59.580538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:59.581155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:59.581427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:59.581695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:59.582454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:19:59.582752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:59.584149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:59.588859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae30fc2-32da-4f83-9e39-e6e7c7e57e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:59.590349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae30fc2-32da-4f83-9e39-e6e7c7e57e09 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:59.606112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 129/257] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:19:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:59.606981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:59.680836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:59.719889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 129/258] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 14:19:59.720544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae30fc2-32da-4f83-9e39-e6e7c7e57e09 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:59.783924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271a59-27db-4788-b3bc-7b34a0a5aa3e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:59.798340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:19:59.818934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39416358-e795-4ad4-a1fc-975e7f9005fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:59.819583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39416358-e795-4ad4-a1fc-975e7f9005fb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:59.819858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39416358-e795-4ad4-a1fc-975e7f9005fb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:59.820127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39416358-e795-4ad4-a1fc-975e7f9005fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:59.831055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae30fc2-32da-4f83-9e39-e6e7c7e57e09 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:19:59.851020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39416358-e795-4ad4-a1fc-975e7f9005fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-39416358-e795-4ad4-a1fc-975e7f9005fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:19:59.856686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:19:59.857604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:19:59.858575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:19:59.866487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 130/259] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:19:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:19:59.867700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39416358-e795-4ad4-a1fc-975e7f9005fb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:19:59.870294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2a3a7-e14c-44f0-aa84-816fb3edefb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:19:59.871333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a3a7-e14c-44f0-aa84-816fb3edefb7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:19:59.871677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a3a7-e14c-44f0-aa84-816fb3edefb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:19:59.872023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a3a7-e14c-44f0-aa84-816fb3edefb7 None admin] PATH_INFO: `/v3/users/cd22dc76de994cdab0bbaa4d12a3f91e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:19:59.873575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2a3a7-e14c-44f0-aa84-816fb3edefb7 None admin] RBAC: Authorizing `identity:get_user(user_id=cd22dc76de994cdab0bbaa4d12a3f91e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:19:59.884759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2a3a7-e14c-44f0-aa84-816fb3edefb7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:19:59.884759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 130/260] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:19:59 2022] GET /identity/v3/users/cd22dc76de994cdab0bbaa4d12a3f91e => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:19:59.884759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2a3a7-e14c-44f0-aa84-816fb3edefb7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:00.061366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:00.067898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39416358-e795-4ad4-a1fc-975e7f9005fb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:00.084531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2a3a7-e14c-44f0-aa84-816fb3edefb7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:00.116812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f011ced-46ac-4d1c-9de2-0152daab4366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:00.117823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f011ced-46ac-4d1c-9de2-0152daab4366 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:00.118498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f011ced-46ac-4d1c-9de2-0152daab4366 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:00.119004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f011ced-46ac-4d1c-9de2-0152daab4366 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:00.120614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f011ced-46ac-4d1c-9de2-0152daab4366 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:00.122298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f011ced-46ac-4d1c-9de2-0152daab4366 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:00.124537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 131/261] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:19:59 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:00.125631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f011ced-46ac-4d1c-9de2-0152daab4366 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:00.162731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:00.164299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:00.164999 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:00.165939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:00.167023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:00.167675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:00.171025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:00.175814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:00.193203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 131/262] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:19:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:00.194377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:00.289024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f011ced-46ac-4d1c-9de2-0152daab4366 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:00.324329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58283ef-5151-4377-a591-f6f8c7375e51 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:00.325385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42785e59-8b79-4457-835b-7db991b2c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:00.326054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42785e59-8b79-4457-835b-7db991b2c827 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:00.326335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42785e59-8b79-4457-835b-7db991b2c827 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:00.326608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42785e59-8b79-4457-835b-7db991b2c827 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:00.327746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42785e59-8b79-4457-835b-7db991b2c827 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:00.329227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42785e59-8b79-4457-835b-7db991b2c827 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:00.332256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 132/263] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:00 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:00.332873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42785e59-8b79-4457-835b-7db991b2c827 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:00.368446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:00.399546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:00.400170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:00.400453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:00.400722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:00.401455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=51900785ee9d499d9709cae42cfc5db2, user.id=af92443031924e978f97f22b9e085274) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:00.401763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:00.403407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:00.418296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 132/264] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:00 2022] GET /identity/v3/role_assignments?user.id=af92443031924e978f97f22b9e085274&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:00.418296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:00.466329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42785e59-8b79-4457-835b-7db991b2c827 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:00.550366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:00.551358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f652e-d836-4741-8067-83a6362150ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:00.552022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f652e-d836-4741-8067-83a6362150ff None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:00.552349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f652e-d836-4741-8067-83a6362150ff None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:00.552628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f652e-d836-4741-8067-83a6362150ff None admin] PATH_INFO: `/v3/users/af92443031924e978f97f22b9e085274` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:00.553899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f652e-d836-4741-8067-83a6362150ff None admin] RBAC: Authorizing `identity:get_user(user_id=af92443031924e978f97f22b9e085274)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:00.555417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f652e-d836-4741-8067-83a6362150ff None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:00.561276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 133/265] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:00 2022] GET /identity/v3/users/af92443031924e978f97f22b9e085274 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:00.565557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f652e-d836-4741-8067-83a6362150ff None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:00.621158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0d6f4-567f-4c81-a2a0-6bc992fd3902 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:00.684642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ad51-a3b1-4c11-8cbd-3eca868c0479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:00.685323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ad51-a3b1-4c11-8cbd-3eca868c0479 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:00.685606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ad51-a3b1-4c11-8cbd-3eca868c0479 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:00.685882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135ad51-a3b1-4c11-8cbd-3eca868c0479 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2/users/cd22dc76de994cdab0bbaa4d12a3f91e/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:00.688560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ad51-a3b1-4c11-8cbd-3eca868c0479 None admin] RBAC: Authorizing `identity:create_grant(project_id=51900785ee9d499d9709cae42cfc5db2, user_id=cd22dc76de994cdab0bbaa4d12a3f91e, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:00.690126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135ad51-a3b1-4c11-8cbd-3eca868c0479 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:00.746668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f652e-d836-4741-8067-83a6362150ff None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:00.750339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:00.786271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6899-9d02-4041-b597-e213e909077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:00.786919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6899-9d02-4041-b597-e213e909077d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:00.787195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6899-9d02-4041-b597-e213e909077d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:00.787464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6899-9d02-4041-b597-e213e909077d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:00.808380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 133/266] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:20:00 2022] PUT /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2/users/cd22dc76de994cdab0bbaa4d12a3f91e/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:00.866725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd6899-9d02-4041-b597-e213e909077d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:00.868207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd6899-9d02-4041-b597-e213e909077d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:00.988194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 134/267] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:00.993887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ad51-a3b1-4c11-8cbd-3eca868c0479 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:01.147502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135ad51-a3b1-4c11-8cbd-3eca868c0479 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:01.169809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:01.189468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302030e-0cd4-4994-afeb-26371c93e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:01.189830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302030e-0cd4-4994-afeb-26371c93e4ac None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.190138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302030e-0cd4-4994-afeb-26371c93e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.190415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302030e-0cd4-4994-afeb-26371c93e4ac None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.191616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302030e-0cd4-4994-afeb-26371c93e4ac None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:01.193109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302030e-0cd4-4994-afeb-26371c93e4ac None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:01.195193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 134/268] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:00 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:01.203089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6899-9d02-4041-b597-e213e909077d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:01.205922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:01.256408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfc80-4ec5-4968-8f7b-cfa070ec1fdd None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.256702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfc80-4ec5-4968-8f7b-cfa070ec1fdd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.256970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bfc80-4ec5-4968-8f7b-cfa070ec1fdd None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.258490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 135/269] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:01.268143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cdcc-e23b-4695-af1e-e0d36af793ca None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.268418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cdcc-e23b-4695-af1e-e0d36af793ca None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.268615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999cdcc-e23b-4695-af1e-e0d36af793ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.299023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e999cdcc-e23b-4695-af1e-e0d36af793ca None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:01.300243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e999cdcc-e23b-4695-af1e-e0d36af793ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:01.343174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6899-9d02-4041-b597-e213e909077d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:01.384377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488abbf-7990-4a0d-a7f1-54a3c93e6999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:01.385357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488abbf-7990-4a0d-a7f1-54a3c93e6999 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.385860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488abbf-7990-4a0d-a7f1-54a3c93e6999 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.386358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488abbf-7990-4a0d-a7f1-54a3c93e6999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.387289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488abbf-7990-4a0d-a7f1-54a3c93e6999 None admin] RBAC: Adding query filter params (role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=51900785ee9d499d9709cae42cfc5db2, user.id=af92443031924e978f97f22b9e085274) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:01.387963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488abbf-7990-4a0d-a7f1-54a3c93e6999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:01.390575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488abbf-7990-4a0d-a7f1-54a3c93e6999 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:01.399270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 135/270] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:01 2022] GET /identity/v3/role_assignments?user.id=af92443031924e978f97f22b9e085274&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:01.454125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 136/271] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:01.585348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b088c-bbb8-4fce-9df4-5749bf9cd655 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.585967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b088c-bbb8-4fce-9df4-5749bf9cd655 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.586475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b088c-bbb8-4fce-9df4-5749bf9cd655 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.588402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 136/272] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:01.593867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85edc-b592-4d6d-964d-b041227e6dc3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.594347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85edc-b592-4d6d-964d-b041227e6dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.594724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85edc-b592-4d6d-964d-b041227e6dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.616356 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-03c85edc-b592-4d6d-964d-b041227e6dc3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:01.617567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-03c85edc-b592-4d6d-964d-b041227e6dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:01.701773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 137/273] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:01.753971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c7c4-46ce-4c00-8250-63c4eddced23 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.754625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c7c4-46ce-4c00-8250-63c4eddced23 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.755102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c7c4-46ce-4c00-8250-63c4eddced23 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.756659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 137/274] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:01.762108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6d07-b06a-4c55-83dd-50b4b2fe3a82 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.762398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6d07-b06a-4c55-83dd-50b4b2fe3a82 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.762676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6d07-b06a-4c55-83dd-50b4b2fe3a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.784507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d98a6d07-b06a-4c55-83dd-50b4b2fe3a82 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:01.785709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d98a6d07-b06a-4c55-83dd-50b4b2fe3a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:01.810252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925c7c4-46ce-4c00-8250-63c4eddced23 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:01.841775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:01.868687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 138/275] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:01.900398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:01.942548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925c7c4-46ce-4c00-8250-63c4eddced23 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:01.980973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa501d1f-18ae-4bb2-9f45-c1fdbc7aedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:01.982005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa501d1f-18ae-4bb2-9f45-c1fdbc7aedea None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:01.982508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa501d1f-18ae-4bb2-9f45-c1fdbc7aedea None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:01.982983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa501d1f-18ae-4bb2-9f45-c1fdbc7aedea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:01.994330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a6d07-b06a-4c55-83dd-50b4b2fe3a82 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:01.996324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa501d1f-18ae-4bb2-9f45-c1fdbc7aedea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-aa501d1f-18ae-4bb2-9f45-c1fdbc7aedea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:02.003765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:02.004678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:02.005606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:02.007820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 138/276] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:02.013594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa501d1f-18ae-4bb2-9f45-c1fdbc7aedea None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:02.128775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a6d07-b06a-4c55-83dd-50b4b2fe3a82 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:02.143941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa501d1f-18ae-4bb2-9f45-c1fdbc7aedea None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:02.169166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d614459-28c4-48d8-9ab9-cb908ac4c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:02.170336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d614459-28c4-48d8-9ab9-cb908ac4c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:02.170752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d614459-28c4-48d8-9ab9-cb908ac4c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:02.171167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d614459-28c4-48d8-9ab9-cb908ac4c0c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:02.172380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d614459-28c4-48d8-9ab9-cb908ac4c0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:02.174696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d614459-28c4-48d8-9ab9-cb908ac4c0c6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:02.175896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:02.182263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 139/277] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:02.183435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d614459-28c4-48d8-9ab9-cb908ac4c0c6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:02.185208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:02.185818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:02.186132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:02.186400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:02.187248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:02.192571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:02.192571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:02.199240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 139/278] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:02.200012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:02.245491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:02.307163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d614459-28c4-48d8-9ab9-cb908ac4c0c6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:02.311585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf820d74-1d99-4b3f-8a28-377211593f08 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:02.346439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046a0a-9567-4992-b722-32cc78e77fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:02.347040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046a0a-9567-4992-b722-32cc78e77fb8 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:02.347316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046a0a-9567-4992-b722-32cc78e77fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:02.347584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c046a0a-9567-4992-b722-32cc78e77fb8 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:02.348222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c046a0a-9567-4992-b722-32cc78e77fb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:02.349652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c046a0a-9567-4992-b722-32cc78e77fb8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:02.349832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb1e3-cf2c-4647-9ed9-7ad2c319d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:02.350838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb1e3-cf2c-4647-9ed9-7ad2c319d98d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:02.351297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb1e3-cf2c-4647-9ed9-7ad2c319d98d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:02.351733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb1e3-cf2c-4647-9ed9-7ad2c319d98d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:02.368668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbb1e3-cf2c-4647-9ed9-7ad2c319d98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-13dbb1e3-cf2c-4647-9ed9-7ad2c319d98d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:02.378917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:02.379989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:02.380969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:02.381622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 140/279] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:02.382583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb1e3-cf2c-4647-9ed9-7ad2c319d98d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:02.420682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 140/280] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:20:02 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:02.421576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046a0a-9567-4992-b722-32cc78e77fb8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:02.489657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:02.532328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb1e3-cf2c-4647-9ed9-7ad2c319d98d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:02.541809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:02.567087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c046a0a-9567-4992-b722-32cc78e77fb8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:02.574985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f85204-4ce1-4451-abbb-9664a6c599e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:02.575833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85204-4ce1-4451-abbb-9664a6c599e9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:02.576009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85204-4ce1-4451-abbb-9664a6c599e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:02.576282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f85204-4ce1-4451-abbb-9664a6c599e9 None admin] PATH_INFO: `/v3/users/339159d30249432f80d66e9a76d71005` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:02.598542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f85204-4ce1-4451-abbb-9664a6c599e9 None admin] RBAC: Authorizing `identity:get_user(user_id=339159d30249432f80d66e9a76d71005)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:02.600466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f85204-4ce1-4451-abbb-9664a6c599e9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:02.608310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 141/281] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:02 2022] GET /identity/v3/users/339159d30249432f80d66e9a76d71005 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:02.609497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f85204-4ce1-4451-abbb-9664a6c599e9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:02.618764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:02.619741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:02.620227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:02.620736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:02.621711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:02.622065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:02.623684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:02.638395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 141/282] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:02.640787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:02.763921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f85204-4ce1-4451-abbb-9664a6c599e9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:02.769256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3198af-47bd-4086-aa59-d9e970835ba5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:02.778932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:02.805670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:02.806337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:02.806621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:02.806897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:02.807688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] RBAC: Adding query filter params (role.id=2be9f83593d64e6ea6877bccf0dda44c, user.id=339159d30249432f80d66e9a76d71005, scope.system=all) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:02.808004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:02.809451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:02.814792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7630780-e0e7-49c8-bbf9-4da236a9c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:02.815490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7630780-e0e7-49c8-bbf9-4da236a9c01f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:02.815766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7630780-e0e7-49c8-bbf9-4da236a9c01f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:02.816036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7630780-e0e7-49c8-bbf9-4da236a9c01f None admin] PATH_INFO: `/v3/users/ad81ea9f3a33494c910210749c32e91e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:02.816734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 142/283] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Sep 22 14:20:02 2022] GET /identity/v3/role_assignments?user.id=339159d30249432f80d66e9a76d71005&scope.system=all&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:02.817406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7630780-e0e7-49c8-bbf9-4da236a9c01f None admin] RBAC: Authorizing `identity:get_user(user_id=ad81ea9f3a33494c910210749c32e91e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:02.818953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7630780-e0e7-49c8-bbf9-4da236a9c01f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:02.820914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 142/284] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:02 2022] GET /identity/v3/users/ad81ea9f3a33494c910210749c32e91e => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:02.826347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:02.867456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:02.994272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd93d4-905d-4c5f-a2fb-fbe1061886ed None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:03.031607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62afd00-9001-49e9-8eee-2702b24beab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:03.033231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62afd00-9001-49e9-8eee-2702b24beab2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:03.033745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62afd00-9001-49e9-8eee-2702b24beab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:03.034235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62afd00-9001-49e9-8eee-2702b24beab2 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:03.035630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62afd00-9001-49e9-8eee-2702b24beab2 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:03.037313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62afd00-9001-49e9-8eee-2702b24beab2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:03.039561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 143/285] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:02 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:03.045074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7630780-e0e7-49c8-bbf9-4da236a9c01f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:03.185684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7630780-e0e7-49c8-bbf9-4da236a9c01f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:03.238206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03275d-6d96-4fbf-ac71-bfefa73f55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:03.238894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03275d-6d96-4fbf-ac71-bfefa73f55a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:03.239178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03275d-6d96-4fbf-ac71-bfefa73f55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:03.239458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03275d-6d96-4fbf-ac71-bfefa73f55a8 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2/users/ad81ea9f3a33494c910210749c32e91e/roles/b79d313a30ab46dca3bc5d0b3caca61a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:03.247649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03275d-6d96-4fbf-ac71-bfefa73f55a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=51900785ee9d499d9709cae42cfc5db2, user_id=ad81ea9f3a33494c910210749c32e91e, role_id=b79d313a30ab46dca3bc5d0b3caca61a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:03.249066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03275d-6d96-4fbf-ac71-bfefa73f55a8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:03.324675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 143/286] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:20:03 2022] PUT /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2/users/ad81ea9f3a33494c910210749c32e91e/roles/b79d313a30ab46dca3bc5d0b3caca61a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:03.558495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d536df-7714-442e-95aa-aff6a2066c72 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:03.558836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d536df-7714-442e-95aa-aff6a2066c72 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:03.559008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d536df-7714-442e-95aa-aff6a2066c72 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:03.560602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 144/287] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:03.567329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f760b8-8d3b-49d5-83b4-6fdf70687b6c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:03.567650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f760b8-8d3b-49d5-83b4-6fdf70687b6c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:03.567894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f760b8-8d3b-49d5-83b4-6fdf70687b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:03.595671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-33f760b8-8d3b-49d5-83b4-6fdf70687b6c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:03.596985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-33f760b8-8d3b-49d5-83b4-6fdf70687b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:03.626809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:03.671406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 144/288] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:04.017552 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d536df-7714-442e-95aa-aff6a2066c72 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:04.115889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:04.123432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d536df-7714-442e-95aa-aff6a2066c72 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:04.158701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2f031-dd73-4582-9b21-acc522dfa9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:04.159329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2f031-dd73-4582-9b21-acc522dfa9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:04.159607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2f031-dd73-4582-9b21-acc522dfa9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:04.159878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2f031-dd73-4582-9b21-acc522dfa9d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:04.170360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2f031-dd73-4582-9b21-acc522dfa9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-a0f2f031-dd73-4582-9b21-acc522dfa9d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:04.176096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:04.177002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:04.178307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 145/289] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:04.183232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f760b8-8d3b-49d5-83b4-6fdf70687b6c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:04.296972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f760b8-8d3b-49d5-83b4-6fdf70687b6c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:04.350006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:04.350006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:04.350006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:04.350006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:04.350826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:04.350826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:04.358413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:04.371314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 145/290] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:04.376688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2f031-dd73-4582-9b21-acc522dfa9d1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:04.524503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2f031-dd73-4582-9b21-acc522dfa9d1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:04.568144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee90944-f686-488f-939f-f4732f588cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:04.568696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee90944-f686-488f-939f-f4732f588cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:04.568978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee90944-f686-488f-939f-f4732f588cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:04.569256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee90944-f686-488f-939f-f4732f588cc4 None admin] PATH_INFO: `/v3/users/cd22dc76de994cdab0bbaa4d12a3f91e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:04.570443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee90944-f686-488f-939f-f4732f588cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=cd22dc76de994cdab0bbaa4d12a3f91e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:04.571895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee90944-f686-488f-939f-f4732f588cc4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:04.573709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 146/291] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:04 2022] GET /identity/v3/users/cd22dc76de994cdab0bbaa4d12a3f91e => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:04.579704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:04.621342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:04.710543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cef53-7dae-4b4f-8838-ff20ea38af30 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:04.745873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba0259-2b1f-4bf7-a668-a18f62ab8b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:04.746514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba0259-2b1f-4bf7-a668-a18f62ab8b79 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:04.746788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba0259-2b1f-4bf7-a668-a18f62ab8b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:04.747054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba0259-2b1f-4bf7-a668-a18f62ab8b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:04.832992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba0259-2b1f-4bf7-a668-a18f62ab8b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:04.834430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba0259-2b1f-4bf7-a668-a18f62ab8b79 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:04.872620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:04.960649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 146/292] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:04.966201 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee90944-f686-488f-939f-f4732f588cc4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:05.010969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:05.100040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee90944-f686-488f-939f-f4732f588cc4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:05.154760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9cf77-ac21-4082-b960-d74538769546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:05.155547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9cf77-ac21-4082-b960-d74538769546 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.155706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9cf77-ac21-4082-b960-d74538769546 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.155958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9cf77-ac21-4082-b960-d74538769546 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.157253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9cf77-ac21-4082-b960-d74538769546 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:05.159556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9cf77-ac21-4082-b960-d74538769546 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:05.161589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 147/293] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:04 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:05.167056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba0259-2b1f-4bf7-a668-a18f62ab8b79 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:05.262145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ea40-2e88-42ab-8467-ad408a82001f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.262459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ea40-2e88-42ab-8467-ad408a82001f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.262714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ea40-2e88-42ab-8467-ad408a82001f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.264200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 148/294] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:20:05.272472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f837f-d8bc-4426-baad-d95015784f66 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.272757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f837f-d8bc-4426-baad-d95015784f66 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.273037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f837f-d8bc-4426-baad-d95015784f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.303818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba0259-2b1f-4bf7-a668-a18f62ab8b79 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:05.323023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c59f837f-d8bc-4426-baad-d95015784f66 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:05.324238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c59f837f-d8bc-4426-baad-d95015784f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:05.342003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:05.346176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f14e-94a6-479f-bbfd-dbc71bebab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:05.346813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f14e-94a6-479f-bbfd-dbc71bebab24 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.347088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f14e-94a6-479f-bbfd-dbc71bebab24 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.347357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f14e-94a6-479f-bbfd-dbc71bebab24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.348100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f14e-94a6-479f-bbfd-dbc71bebab24 None admin] RBAC: Adding query filter params (role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=51900785ee9d499d9709cae42cfc5db2, user.id=cd22dc76de994cdab0bbaa4d12a3f91e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:05.348405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f14e-94a6-479f-bbfd-dbc71bebab24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:05.349862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f14e-94a6-479f-bbfd-dbc71bebab24 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:05.367705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 147/295] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:05 2022] GET /identity/v3/role_assignments?user.id=cd22dc76de994cdab0bbaa4d12a3f91e&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:05.427330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 149/296] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:05.485498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dc205-f36a-4df9-b75b-cffdfd8a872b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.486166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dc205-f36a-4df9-b75b-cffdfd8a872b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.486643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dc205-f36a-4df9-b75b-cffdfd8a872b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.488508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 148/297] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:05.494400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515c04-0400-4ef9-96b1-93c1fa106b6d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.494708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515c04-0400-4ef9-96b1-93c1fa106b6d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.494948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52515c04-0400-4ef9-96b1-93c1fa106b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.514316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-52515c04-0400-4ef9-96b1-93c1fa106b6d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:05.515520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-52515c04-0400-4ef9-96b1-93c1fa106b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:05.535237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:05.578771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c9d9-d81d-4e2a-9b84-d9c79bea0391 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.579720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c9d9-d81d-4e2a-9b84-d9c79bea0391 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.580592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3c9d9-d81d-4e2a-9b84-d9c79bea0391 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.586061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 149/298] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:05.587791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee60e-e595-448e-abad-73277355d448 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.588076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee60e-e595-448e-abad-73277355d448 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.588350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ee60e-e595-448e-abad-73277355d448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.590836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 150/299] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:05.629369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3a8ee60e-e595-448e-abad-73277355d448 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:05.630565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3a8ee60e-e595-448e-abad-73277355d448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:05.707927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 150/300] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:05.791852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52515c04-0400-4ef9-96b1-93c1fa106b6d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:05.875852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ee60e-e595-448e-abad-73277355d448 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:05.902992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52515c04-0400-4ef9-96b1-93c1fa106b6d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:05.942293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc87bf-6a5b-4992-82eb-049154e44fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:05.943204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc87bf-6a5b-4992-82eb-049154e44fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:05.943646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc87bf-6a5b-4992-82eb-049154e44fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:05.944042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc87bf-6a5b-4992-82eb-049154e44fc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:05.945307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc87bf-6a5b-4992-82eb-049154e44fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:05.946895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc87bf-6a5b-4992-82eb-049154e44fc6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:05.948928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 151/301] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:05.956342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc87bf-6a5b-4992-82eb-049154e44fc6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:05.993763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:06.021432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ee60e-e595-448e-abad-73277355d448 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.045046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:06.061135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00728182-fa5a-427e-a1cf-57b2e43dda3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.061778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00728182-fa5a-427e-a1cf-57b2e43dda3d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.062088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00728182-fa5a-427e-a1cf-57b2e43dda3d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.062365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00728182-fa5a-427e-a1cf-57b2e43dda3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.072754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00728182-fa5a-427e-a1cf-57b2e43dda3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-00728182-fa5a-427e-a1cf-57b2e43dda3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:06.077928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:06.079060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:06.080645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:06.083074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 151/302] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:06.084461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00728182-fa5a-427e-a1cf-57b2e43dda3d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:06.091536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc87bf-6a5b-4992-82eb-049154e44fc6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.128420 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6530c-9816-4d53-a695-abc9391b82b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.129034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6530c-9816-4d53-a695-abc9391b82b1 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.129314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6530c-9816-4d53-a695-abc9391b82b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.129588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6530c-9816-4d53-a695-abc9391b82b1 None admin] PATH_INFO: `/v3/groups` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.130249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6530c-9816-4d53-a695-abc9391b82b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:06.131677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6530c-9816-4d53-a695-abc9391b82b1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:06.191443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00728182-fa5a-427e-a1cf-57b2e43dda3d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.226810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f2294-7a14-4dff-bc80-d2fa84dd087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.227451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f2294-7a14-4dff-bc80-d2fa84dd087a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.227733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f2294-7a14-4dff-bc80-d2fa84dd087a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.228008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f2294-7a14-4dff-bc80-d2fa84dd087a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.238006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 152/303] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Sep 22 14:20:05 2022] POST /identity/v3/groups => generated 229 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:06.238006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6530c-9816-4d53-a695-abc9391b82b1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:06.247222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f2294-7a14-4dff-bc80-d2fa84dd087a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ad8f2294-7a14-4dff-bc80-d2fa84dd087a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:06.252770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:06.253772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:06.254618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 152/304] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:06.260493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f2294-7a14-4dff-bc80-d2fa84dd087a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:06.351587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:06.368066 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:06.392641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6530c-9816-4d53-a695-abc9391b82b1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.438523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e211d5-2af4-48ca-b2ac-69247de93948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.439807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e211d5-2af4-48ca-b2ac-69247de93948 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.440095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e211d5-2af4-48ca-b2ac-69247de93948 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.440372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e211d5-2af4-48ca-b2ac-69247de93948 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.441124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e211d5-2af4-48ca-b2ac-69247de93948 None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:06.441432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e211d5-2af4-48ca-b2ac-69247de93948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:06.448608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f2294-7a14-4dff-bc80-d2fa84dd087a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.449080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e211d5-2af4-48ca-b2ac-69247de93948 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:06.456127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 153/305] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:06.457500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af218-4f65-4260-8a81-d822faa0aca8 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.457794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af218-4f65-4260-8a81-d822faa0aca8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.458101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9af218-4f65-4260-8a81-d822faa0aca8 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.459689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 154/306] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:06.465335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9af218-4f65-4260-8a81-d822faa0aca8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:06.483712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89846145-f3cb-4607-813a-bac8b1a5ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.484335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846145-f3cb-4607-813a-bac8b1a5ce3d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.484617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846145-f3cb-4607-813a-bac8b1a5ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.484891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846145-f3cb-4607-813a-bac8b1a5ce3d None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.486271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89846145-f3cb-4607-813a-bac8b1a5ce3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:06.486561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89846145-f3cb-4607-813a-bac8b1a5ce3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:06.487969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89846145-f3cb-4607-813a-bac8b1a5ce3d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:06.496472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 153/307] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:06.503084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee9b1-286f-4c21-8c36-ba2eb5578662 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.503371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee9b1-286f-4c21-8c36-ba2eb5578662 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.503649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee9b1-286f-4c21-8c36-ba2eb5578662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.522703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f6bee9b1-286f-4c21-8c36-ba2eb5578662 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:06.523905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f6bee9b1-286f-4c21-8c36-ba2eb5578662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:06.577592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9af218-4f65-4260-8a81-d822faa0aca8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.597019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 154/308] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:06.598246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bee9b1-286f-4c21-8c36-ba2eb5578662 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:06.629336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25e346-a867-47ba-8556-3763630e5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.630198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e346-a867-47ba-8556-3763630e5357 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.630558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e346-a867-47ba-8556-3763630e5357 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.630896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e346-a867-47ba-8556-3763630e5357 None admin] PATH_INFO: `/v3/users/339159d30249432f80d66e9a76d71005` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.632117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25e346-a867-47ba-8556-3763630e5357 None admin] RBAC: Authorizing `identity:get_user(user_id=339159d30249432f80d66e9a76d71005)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:06.633938 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25e346-a867-47ba-8556-3763630e5357 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:06.640029 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 155/309] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:06 2022] GET /identity/v3/users/339159d30249432f80d66e9a76d71005 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:06.640154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:06.641907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25e346-a867-47ba-8556-3763630e5357 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:06.658100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:06.735846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bee9b1-286f-4c21-8c36-ba2eb5578662 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.765112 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25e346-a867-47ba-8556-3763630e5357 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.777014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334472-80f8-455a-a982-3b0686d413b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.778067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334472-80f8-455a-a982-3b0686d413b0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.778542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334472-80f8-455a-a982-3b0686d413b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.779026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334472-80f8-455a-a982-3b0686d413b0 None admin] PATH_INFO: `/v3/users/88adc90dd21346439cd70fa9f3a6f365` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.794258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4334472-80f8-455a-a982-3b0686d413b0 None admin] RBAC: Authorizing `identity:get_user(user_id=88adc90dd21346439cd70fa9f3a6f365)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:06.796291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4334472-80f8-455a-a982-3b0686d413b0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:06.800448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 155/310] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:06 2022] GET /identity/v3/users/88adc90dd21346439cd70fa9f3a6f365 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:06.810073 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334472-80f8-455a-a982-3b0686d413b0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:06.810228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32a1f-b630-46df-a95d-6b95247e20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.810228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32a1f-b630-46df-a95d-6b95247e20cb None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.810228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32a1f-b630-46df-a95d-6b95247e20cb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.810228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32a1f-b630-46df-a95d-6b95247e20cb None admin] PATH_INFO: `/v3/system/users/339159d30249432f80d66e9a76d71005/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.811126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec32a1f-b630-46df-a95d-6b95247e20cb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=339159d30249432f80d66e9a76d71005, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:06.812480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec32a1f-b630-46df-a95d-6b95247e20cb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:06.905588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:06.915348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334472-80f8-455a-a982-3b0686d413b0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:06.929714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 156/311] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Sep 22 14:20:06 2022] PUT /identity/v3/system/users/339159d30249432f80d66e9a76d71005/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:20:06.930840 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32a1f-b630-46df-a95d-6b95247e20cb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:06.955707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:06.956619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:06.957044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:06.957458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:06.958458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] RBAC: Adding query filter params (role.id=b79d313a30ab46dca3bc5d0b3caca61a, user.id=88adc90dd21346439cd70fa9f3a6f365, scope.system=all) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:06.958979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:06.960634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:06.968171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 156/312] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Sep 22 14:20:06 2022] GET /identity/v3/role_assignments?user.id=88adc90dd21346439cd70fa9f3a6f365&scope.system=all&role.id=b79d313a30ab46dca3bc5d0b3caca61a => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:07.041419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:07.074419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32a1f-b630-46df-a95d-6b95247e20cb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:07.116276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b123-c6dc-4df4-a2aa-6902e2822679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:07.116942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b123-c6dc-4df4-a2aa-6902e2822679 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:07.117219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b123-c6dc-4df4-a2aa-6902e2822679 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:07.117488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0b123-c6dc-4df4-a2aa-6902e2822679 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:07.130801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0b123-c6dc-4df4-a2aa-6902e2822679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-fef0b123-c6dc-4df4-a2aa-6902e2822679 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:07.136340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:07.137401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:07.138233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 157/313] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:07.143738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:07.259581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0300e80-0cbf-4889-8925-48ac238a14f2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:07.298291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:07.298807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:07.299085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:07.299355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:07.300108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:07.300409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:07.301798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:07.310991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 157/314] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:07.316982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b123-c6dc-4df4-a2aa-6902e2822679 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:07.424179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0b123-c6dc-4df4-a2aa-6902e2822679 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:07.458651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbbeb6-c5af-48de-8795-29fe0cb077fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:07.459279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbbeb6-c5af-48de-8795-29fe0cb077fc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:07.459584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbbeb6-c5af-48de-8795-29fe0cb077fc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:07.459830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbbeb6-c5af-48de-8795-29fe0cb077fc None admin] PATH_INFO: `/v3/users/ad81ea9f3a33494c910210749c32e91e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:07.460960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbbeb6-c5af-48de-8795-29fe0cb077fc None admin] RBAC: Authorizing `identity:get_user(user_id=ad81ea9f3a33494c910210749c32e91e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:07.462433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbbeb6-c5af-48de-8795-29fe0cb077fc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:07.464396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 158/315] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:07 2022] GET /identity/v3/users/ad81ea9f3a33494c910210749c32e91e => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:07.470442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:07.491756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:07.594401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c6872-13b8-4b51-8b3e-833b5b4b5b79 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:07.633514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5828f1-d479-45e6-89d8-4fd7ad8c6c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:07.634212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5828f1-d479-45e6-89d8-4fd7ad8c6c0e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:07.634502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5828f1-d479-45e6-89d8-4fd7ad8c6c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:07.634777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5828f1-d479-45e6-89d8-4fd7ad8c6c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:07.709817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5828f1-d479-45e6-89d8-4fd7ad8c6c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:07.711326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5828f1-d479-45e6-89d8-4fd7ad8c6c0e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:07.729740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:07.818291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 158/316] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:07.823704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbbeb6-c5af-48de-8795-29fe0cb077fc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:07.826655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:07.972106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbbeb6-c5af-48de-8795-29fe0cb077fc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:08.007890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b410e-2fe6-411c-b4f2-c7208a3f1b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:08.008522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b410e-2fe6-411c-b4f2-c7208a3f1b94 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:08.008798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b410e-2fe6-411c-b4f2-c7208a3f1b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:08.009066 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b410e-2fe6-411c-b4f2-c7208a3f1b94 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:08.010233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b410e-2fe6-411c-b4f2-c7208a3f1b94 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:08.011660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b410e-2fe6-411c-b4f2-c7208a3f1b94 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:08.013571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 159/317] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:07 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:08.021546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5828f1-d479-45e6-89d8-4fd7ad8c6c0e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:08.160699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5828f1-d479-45e6-89d8-4fd7ad8c6c0e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:08.184382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:08.209191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d862034-6166-453c-9260-58fc2af9873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:08.210091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862034-6166-453c-9260-58fc2af9873b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:08.210491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862034-6166-453c-9260-58fc2af9873b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:08.210871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d862034-6166-453c-9260-58fc2af9873b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:08.211998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d862034-6166-453c-9260-58fc2af9873b None admin] RBAC: Adding query filter params (role.id=b79d313a30ab46dca3bc5d0b3caca61a, scope.project.id=51900785ee9d499d9709cae42cfc5db2, user.id=ad81ea9f3a33494c910210749c32e91e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:08.212435 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d862034-6166-453c-9260-58fc2af9873b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:08.214731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d862034-6166-453c-9260-58fc2af9873b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:08.225292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 159/318] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:08 2022] GET /identity/v3/role_assignments?user.id=ad81ea9f3a33494c910210749c32e91e&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=b79d313a30ab46dca3bc5d0b3caca61a => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:08.609277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c81a0-8f17-47ac-9dd0-9ddd91fa99a0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:08.609800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c81a0-8f17-47ac-9dd0-9ddd91fa99a0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:08.609800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c81a0-8f17-47ac-9dd0-9ddd91fa99a0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:08.612032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 160/319] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:08.616976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e21b-5886-4a3e-9ffd-bdc88f7c7925 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:08.617373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e21b-5886-4a3e-9ffd-bdc88f7c7925 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:08.617551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6e21b-5886-4a3e-9ffd-bdc88f7c7925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:08.635840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6ac6e21b-5886-4a3e-9ffd-bdc88f7c7925 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:08.637019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6ac6e21b-5886-4a3e-9ffd-bdc88f7c7925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:08.706246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 160/320] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:08.980160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c81a0-8f17-47ac-9dd0-9ddd91fa99a0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:09.056184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:09.088703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c81a0-8f17-47ac-9dd0-9ddd91fa99a0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:09.123639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac150f0-1d64-41a5-a745-2056b6017dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:09.124273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac150f0-1d64-41a5-a745-2056b6017dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:09.124550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac150f0-1d64-41a5-a745-2056b6017dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:09.124821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac150f0-1d64-41a5-a745-2056b6017dd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:09.126521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac150f0-1d64-41a5-a745-2056b6017dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:09.127910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac150f0-1d64-41a5-a745-2056b6017dd6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:09.129687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 161/321] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:09.134956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e21b-5886-4a3e-9ffd-bdc88f7c7925 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:09.251417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6e21b-5886-4a3e-9ffd-bdc88f7c7925 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:09.262576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:09.293497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385a86f-f1f2-4385-92d9-b0adcb7085a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:09.294144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a86f-f1f2-4385-92d9-b0adcb7085a3 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:09.294424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a86f-f1f2-4385-92d9-b0adcb7085a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:09.294695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385a86f-f1f2-4385-92d9-b0adcb7085a3 None admin] PATH_INFO: `/v3/groups` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:09.295338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385a86f-f1f2-4385-92d9-b0adcb7085a3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:09.296772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385a86f-f1f2-4385-92d9-b0adcb7085a3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:09.305272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57369f6-f5be-4f96-baf6-1af12912eab5 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:09.305560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57369f6-f5be-4f96-baf6-1af12912eab5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:09.305832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57369f6-f5be-4f96-baf6-1af12912eab5 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:09.307193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 162/322] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:20:09.311959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b245-41ad-4c7b-a494-27b0cc983aca None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:09.312379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b245-41ad-4c7b-a494-27b0cc983aca None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:09.312718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b245-41ad-4c7b-a494-27b0cc983aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:09.335362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0093b245-41ad-4c7b-a494-27b0cc983aca None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:09.336550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0093b245-41ad-4c7b-a494-27b0cc983aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:09.403532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 161/323] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Sep 22 14:20:09 2022] POST /identity/v3/groups => generated 226 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:09.410055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 163/324] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:09.619429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a67a3-6fa0-469a-943f-5de2d9802d9d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:09.619913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a67a3-6fa0-469a-943f-5de2d9802d9d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:09.620116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a67a3-6fa0-469a-943f-5de2d9802d9d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:09.622059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 162/325] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:09.628154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfdf5-47d1-4701-8575-edbfab8189fb None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:09.628582 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfdf5-47d1-4701-8575-edbfab8189fb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:09.628827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfdf5-47d1-4701-8575-edbfab8189fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:09.647292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-46fdfdf5-47d1-4701-8575-edbfab8189fb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:09.648485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-46fdfdf5-47d1-4701-8575-edbfab8189fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:09.687819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a67a3-6fa0-469a-943f-5de2d9802d9d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:09.717141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:09.723177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 164/326] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:09.827689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a67a3-6fa0-469a-943f-5de2d9802d9d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:09.867598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600152e-81ab-48f1-8509-ec9b8af2b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:09.868238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600152e-81ab-48f1-8509-ec9b8af2b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:09.868514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600152e-81ab-48f1-8509-ec9b8af2b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:09.868783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600152e-81ab-48f1-8509-ec9b8af2b7d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:09.881277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600152e-81ab-48f1-8509-ec9b8af2b7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-b600152e-81ab-48f1-8509-ec9b8af2b7d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:09.887063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:09.887973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:09.888874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 163/327] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:09.894903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdfdf5-47d1-4701-8575-edbfab8189fb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:09.999168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600152e-81ab-48f1-8509-ec9b8af2b7d6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:10.016524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdfdf5-47d1-4701-8575-edbfab8189fb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:10.034181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:10.059057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:10.059679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:10.059955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:10.060228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:10.060904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:10.061205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:10.064633 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:10.077118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 165/328] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:10.083157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:10.127016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600152e-81ab-48f1-8509-ec9b8af2b7d6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:10.177488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94a404-a417-4ddd-9eec-180227b6b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:10.178095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a404-a417-4ddd-9eec-180227b6b21c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:10.178378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a404-a417-4ddd-9eec-180227b6b21c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:10.178652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a404-a417-4ddd-9eec-180227b6b21c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:10.190941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:10.193815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94a404-a417-4ddd-9eec-180227b6b21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-dc94a404-a417-4ddd-9eec-180227b6b21c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:10.200102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:10.201006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:10.201805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:10.202444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 164/329] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:10.207612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94a404-a417-4ddd-9eec-180227b6b21c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:10.221025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e4a82-fe0a-426b-8615-0e4d0ceebe23 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:10.266005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2a1e5-f188-4a95-ad02-4f89e0ff9c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:10.268464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a1e5-f188-4a95-ad02-4f89e0ff9c63 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:10.268900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a1e5-f188-4a95-ad02-4f89e0ff9c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:10.269348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a1e5-f188-4a95-ad02-4f89e0ff9c63 None admin] PATH_INFO: `/v3/users/88adc90dd21346439cd70fa9f3a6f365` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:10.271022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2a1e5-f188-4a95-ad02-4f89e0ff9c63 None admin] RBAC: Authorizing `identity:get_user(user_id=88adc90dd21346439cd70fa9f3a6f365)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:10.272637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2a1e5-f188-4a95-ad02-4f89e0ff9c63 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:10.275274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 166/330] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:10 2022] GET /identity/v3/users/88adc90dd21346439cd70fa9f3a6f365 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:10.280678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2a1e5-f188-4a95-ad02-4f89e0ff9c63 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:10.331917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:10.346055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94a404-a417-4ddd-9eec-180227b6b21c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:10.397481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:10.398744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:10.399620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:10.400403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:10.401566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:10.402119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:10.404408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:10.405305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2a1e5-f188-4a95-ad02-4f89e0ff9c63 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:10.416707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 165/331] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:10.424675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:10.443433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:10.452689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f9f59-2661-4c7a-8e02-39c049c8bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:10.453414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f9f59-2661-4c7a-8e02-39c049c8bbf9 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:10.453698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f9f59-2661-4c7a-8e02-39c049c8bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:10.454044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f9f59-2661-4c7a-8e02-39c049c8bbf9 None admin] PATH_INFO: `/v3/system/users/88adc90dd21346439cd70fa9f3a6f365/roles/b79d313a30ab46dca3bc5d0b3caca61a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:10.456257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f9f59-2661-4c7a-8e02-39c049c8bbf9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=88adc90dd21346439cd70fa9f3a6f365, role_id=b79d313a30ab46dca3bc5d0b3caca61a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:10.457642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f9f59-2661-4c7a-8e02-39c049c8bbf9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:10.535951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 167/332] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Sep 22 14:20:10 2022] PUT /identity/v3/system/users/88adc90dd21346439cd70fa9f3a6f365/roles/b79d313a30ab46dca3bc5d0b3caca61a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:20:10.544807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6d9b0-2656-4f02-bf32-541d7d47d0f2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:10.593138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea23c39-6df2-4629-a234-3c8394295694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:10.594168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23c39-6df2-4629-a234-3c8394295694 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:10.595202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23c39-6df2-4629-a234-3c8394295694 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:10.595819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23c39-6df2-4629-a234-3c8394295694 None admin] PATH_INFO: `/v3/users/339159d30249432f80d66e9a76d71005` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:10.597291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea23c39-6df2-4629-a234-3c8394295694 None admin] RBAC: Authorizing `identity:get_user(user_id=339159d30249432f80d66e9a76d71005)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:10.599171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea23c39-6df2-4629-a234-3c8394295694 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:10.604977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 166/333] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:10 2022] GET /identity/v3/users/339159d30249432f80d66e9a76d71005 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:10.609172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f9f59-2661-4c7a-8e02-39c049c8bbf9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:10.725068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f9f59-2661-4c7a-8e02-39c049c8bbf9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:10.764481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629defed-5223-4cb6-b5d4-8959223261ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:10.765431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629defed-5223-4cb6-b5d4-8959223261ce None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:10.765885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629defed-5223-4cb6-b5d4-8959223261ce None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:10.766456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629defed-5223-4cb6-b5d4-8959223261ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:10.767379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629defed-5223-4cb6-b5d4-8959223261ce None admin] RBAC: Adding query filter params (role.id=2be9f83593d64e6ea6877bccf0dda44c, user.id=339159d30249432f80d66e9a76d71005, scope.system=all) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:10.767907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629defed-5223-4cb6-b5d4-8959223261ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:10.769664 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629defed-5223-4cb6-b5d4-8959223261ce None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:10.787289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 168/334] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Sep 22 14:20:10 2022] GET /identity/v3/role_assignments?user.id=339159d30249432f80d66e9a76d71005&scope.system=all&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:12.077872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5319c4-ba93-4e2b-922f-afcc8ce969da None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:12.078439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5319c4-ba93-4e2b-922f-afcc8ce969da None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:12.078439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5319c4-ba93-4e2b-922f-afcc8ce969da None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:12.080862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 167/335] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:12.087018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51f372-05f4-4f9f-acc9-4bd0e885b145 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:12.087451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51f372-05f4-4f9f-acc9-4bd0e885b145 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:12.087546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51f372-05f4-4f9f-acc9-4bd0e885b145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:12.108382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3b51f372-05f4-4f9f-acc9-4bd0e885b145 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:12.109613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3b51f372-05f4-4f9f-acc9-4bd0e885b145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:12.164072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:12.188656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 169/336] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:12.478946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5319c4-ba93-4e2b-922f-afcc8ce969da None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:12.506812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:12.622639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5319c4-ba93-4e2b-922f-afcc8ce969da None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:12.664559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5e00-b200-461a-9083-8b2e94e1679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:12.665199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5e00-b200-461a-9083-8b2e94e1679d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:12.665481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5e00-b200-461a-9083-8b2e94e1679d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:12.665822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5e00-b200-461a-9083-8b2e94e1679d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:12.682280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f5e00-b200-461a-9083-8b2e94e1679d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-cb4f5e00-b200-461a-9083-8b2e94e1679d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:12.689610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:12.690581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:12.691509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:12.696025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 168/337] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:12.698228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51f372-05f4-4f9f-acc9-4bd0e885b145 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:12.821245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51f372-05f4-4f9f-acc9-4bd0e885b145 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:12.862209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea9b1a-6836-4413-b05f-e65950cc9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:12.862845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9b1a-6836-4413-b05f-e65950cc9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:12.863128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9b1a-6836-4413-b05f-e65950cc9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:12.863401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9b1a-6836-4413-b05f-e65950cc9ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:12.864091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea9b1a-6836-4413-b05f-e65950cc9ab5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:12.864393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea9b1a-6836-4413-b05f-e65950cc9ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:12.865799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea9b1a-6836-4413-b05f-e65950cc9ab5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:12.881733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 170/338] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:12.889925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5e00-b200-461a-9083-8b2e94e1679d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:13.029372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3848c2-91a6-4f5c-88ce-1674c9143ba7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:13.029704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3848c2-91a6-4f5c-88ce-1674c9143ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:13.029931 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3848c2-91a6-4f5c-88ce-1674c9143ba7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:13.031544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 171/339] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:13.049159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ebdfd-8d2d-4254-b947-5c2cc52b8722 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:13.049472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ebdfd-8d2d-4254-b947-5c2cc52b8722 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:13.049780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ebdfd-8d2d-4254-b947-5c2cc52b8722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:13.110276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e97ebdfd-8d2d-4254-b947-5c2cc52b8722 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:13.112140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e97ebdfd-8d2d-4254-b947-5c2cc52b8722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:13.116078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:13.189011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5e00-b200-461a-9083-8b2e94e1679d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:13.212629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:13.277519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 172/340] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:13.352095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a154-54b5-4d30-9253-a2cdc5634ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:13.352808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a154-54b5-4d30-9253-a2cdc5634ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:13.353348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a154-54b5-4d30-9253-a2cdc5634ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:13.353623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a154-54b5-4d30-9253-a2cdc5634ec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:13.398496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc2ce3-d5f6-4412-9d6d-13206f438520 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:13.399008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc2ce3-d5f6-4412-9d6d-13206f438520 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:13.399450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc2ce3-d5f6-4412-9d6d-13206f438520 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:13.401258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 173/341] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:13.415451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a0918-c960-4902-96ac-521caa7ebb7f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:13.416069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a0918-c960-4902-96ac-521caa7ebb7f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:13.416558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a0918-c960-4902-96ac-521caa7ebb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:13.462251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c80a0918-c960-4902-96ac-521caa7ebb7f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:13.463896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c80a0918-c960-4902-96ac-521caa7ebb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:13.497817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8a154-54b5-4d30-9253-a2cdc5634ec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:13.499565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8a154-54b5-4d30-9253-a2cdc5634ec9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:13.574594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 174/342] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:13.624329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:13.653648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 169/343] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:13.659823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a0918-c960-4902-96ac-521caa7ebb7f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:13.777278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a0918-c960-4902-96ac-521caa7ebb7f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:13.779223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:13.819423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d63fd8-f59b-46a4-bde2-4996c1868f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:13.820060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d63fd8-f59b-46a4-bde2-4996c1868f44 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:13.820341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d63fd8-f59b-46a4-bde2-4996c1868f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:13.820612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d63fd8-f59b-46a4-bde2-4996c1868f44 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:13.821739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d63fd8-f59b-46a4-bde2-4996c1868f44 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:13.823186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d63fd8-f59b-46a4-bde2-4996c1868f44 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:13.825092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 175/344] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:13 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:13.832011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a154-54b5-4d30-9253-a2cdc5634ec9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:13.851169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d63fd8-f59b-46a4-bde2-4996c1868f44 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:13.969136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a154-54b5-4d30-9253-a2cdc5634ec9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:14.008228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d63fd8-f59b-46a4-bde2-4996c1868f44 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:14.012603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eddf8-6945-40f0-bd7b-f246232c7645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:14.013253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eddf8-6945-40f0-bd7b-f246232c7645 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.013536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eddf8-6945-40f0-bd7b-f246232c7645 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.013810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eddf8-6945-40f0-bd7b-f246232c7645 None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.022330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eddf8-6945-40f0-bd7b-f246232c7645 None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:14.024035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eddf8-6945-40f0-bd7b-f246232c7645 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:14.028552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 170/345] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:13 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:14.033483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eddf8-6945-40f0-bd7b-f246232c7645 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:14.090101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:14.103076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73993-030d-484d-8dff-ea111ee1910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:14.103734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73993-030d-484d-8dff-ea111ee1910b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.104015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73993-030d-484d-8dff-ea111ee1910b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.104288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73993-030d-484d-8dff-ea111ee1910b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.130823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b73993-030d-484d-8dff-ea111ee1910b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-89b73993-030d-484d-8dff-ea111ee1910b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:14.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:14.142887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:14.143898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:14.148685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 176/346] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:14.154235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73993-030d-484d-8dff-ea111ee1910b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:14.192856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eddf8-6945-40f0-bd7b-f246232c7645 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:14.232574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:14.233502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.233938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.234408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.235915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] RBAC: Adding query filter params (group.id=bbe0cdf741784d449cff6a36f68ab17b, role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=52a1f0f883b14fd1832cf21670c5a803) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:14.236577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:14.238382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:14.246763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 171/347] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:14 2022] GET /identity/v3/role_assignments?group.id=bbe0cdf741784d449cff6a36f68ab17b&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:14.247665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:14.267218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:14.414636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73993-030d-484d-8dff-ea111ee1910b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:14.463712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7fbd3-a420-4bdc-8dd8-1d1b675ec9b7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:14.478450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:14.491425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca246014-52dd-44ce-b321-7386aa8c57f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:14.491963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246014-52dd-44ce-b321-7386aa8c57f6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.492311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246014-52dd-44ce-b321-7386aa8c57f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.492505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca246014-52dd-44ce-b321-7386aa8c57f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.493176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca246014-52dd-44ce-b321-7386aa8c57f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:14.493477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca246014-52dd-44ce-b321-7386aa8c57f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:14.495288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca246014-52dd-44ce-b321-7386aa8c57f6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:14.518166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c26cf-2544-4dac-aa3d-54114eaf6b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:14.518791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 177/348] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:14.519581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c26cf-2544-4dac-aa3d-54114eaf6b49 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.520066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c26cf-2544-4dac-aa3d-54114eaf6b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.520172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34d60b-95ee-4976-bdea-6eccfbc52075 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.520499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34d60b-95ee-4976-bdea-6eccfbc52075 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.520742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34d60b-95ee-4976-bdea-6eccfbc52075 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.521154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c26cf-2544-4dac-aa3d-54114eaf6b49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.522221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 178/349] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:14.530198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf8e2-05f9-443e-b3f3-4d4e2656ac42 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.530450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf8e2-05f9-443e-b3f3-4d4e2656ac42 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.530752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf8e2-05f9-443e-b3f3-4d4e2656ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.537051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c26cf-2544-4dac-aa3d-54114eaf6b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0e8c26cf-2544-4dac-aa3d-54114eaf6b49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:14.544798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:14.545782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 172/350] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:20:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:14.546987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c26cf-2544-4dac-aa3d-54114eaf6b49 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:14.566735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9a6cf8e2-05f9-443e-b3f3-4d4e2656ac42 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:14.568243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9a6cf8e2-05f9-443e-b3f3-4d4e2656ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:14.665685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 179/351] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:14.666448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cf8e2-05f9-443e-b3f3-4d4e2656ac42 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:14.683830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c26cf-2544-4dac-aa3d-54114eaf6b49 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:14.725209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76d4c1-2855-4060-85f2-4c03f65726d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:14.726274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d4c1-2855-4060-85f2-4c03f65726d0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.726732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d4c1-2855-4060-85f2-4c03f65726d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.727165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76d4c1-2855-4060-85f2-4c03f65726d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.740964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:14.772661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:14.812083 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d4c1-2855-4060-85f2-4c03f65726d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:14.814372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76d4c1-2855-4060-85f2-4c03f65726d0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:14.921814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 173/352] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:14.924101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f3562-0660-4865-8a69-6a3f649d1c3c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:14.924702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f3562-0660-4865-8a69-6a3f649d1c3c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:14.929531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f3562-0660-4865-8a69-6a3f649d1c3c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:14.931333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 174/353] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:14.932318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f3562-0660-4865-8a69-6a3f649d1c3c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:14.944021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cf8e2-05f9-443e-b3f3-4d4e2656ac42 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:15.017456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:15.051989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f3562-0660-4865-8a69-6a3f649d1c3c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:15.084277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79273a70-9ffe-4f40-91c4-051ac83ca320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:15.084899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273a70-9ffe-4f40-91c4-051ac83ca320 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.085175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273a70-9ffe-4f40-91c4-051ac83ca320 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.085442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79273a70-9ffe-4f40-91c4-051ac83ca320 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.086153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79273a70-9ffe-4f40-91c4-051ac83ca320 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:15.086452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79273a70-9ffe-4f40-91c4-051ac83ca320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:15.087819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79273a70-9ffe-4f40-91c4-051ac83ca320 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:15.095669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9a489-2c66-4375-91d3-5522ddb2b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:15.096456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a489-2c66-4375-91d3-5522ddb2b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.096738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a489-2c66-4375-91d3-5522ddb2b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.097012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a489-2c66-4375-91d3-5522ddb2b7d4 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.098143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 180/354] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:15.098264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9a489-2c66-4375-91d3-5522ddb2b7d4 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:15.099465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8382a2f-ebb9-49c3-9685-4963210ec271 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.099698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9a489-2c66-4375-91d3-5522ddb2b7d4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:15.099799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8382a2f-ebb9-49c3-9685-4963210ec271 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.100001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8382a2f-ebb9-49c3-9685-4963210ec271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.101480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 175/355] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:14 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:15.102151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9a489-2c66-4375-91d3-5522ddb2b7d4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:15.120028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f8382a2f-ebb9-49c3-9685-4963210ec271 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:15.121214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f8382a2f-ebb9-49c3-9685-4963210ec271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:15.212577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 181/356] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:15.213274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8382a2f-ebb9-49c3-9685-4963210ec271 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:15.251927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:15.256007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9a489-2c66-4375-91d3-5522ddb2b7d4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:15.308606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f891-4bb7-44bd-a6c2-3efa7afb3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:15.309338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f891-4bb7-44bd-a6c2-3efa7afb3b25 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.309721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f891-4bb7-44bd-a6c2-3efa7afb3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.310146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f891-4bb7-44bd-a6c2-3efa7afb3b25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.315145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:15.328482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0f891-4bb7-44bd-a6c2-3efa7afb3b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-abe0f891-4bb7-44bd-a6c2-3efa7afb3b25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:15.334560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:15.335456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:15.336276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 176/357] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:20:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:15.336945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f891-4bb7-44bd-a6c2-3efa7afb3b25 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:15.371686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8382a2f-ebb9-49c3-9685-4963210ec271 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:15.410117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58d8f-4d62-48cf-a7ce-d14ec2051a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:15.410894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58d8f-4d62-48cf-a7ce-d14ec2051a83 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.411270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58d8f-4d62-48cf-a7ce-d14ec2051a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.411636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c58d8f-4d62-48cf-a7ce-d14ec2051a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.474437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0f891-4bb7-44bd-a6c2-3efa7afb3b25 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:15.502319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c58d8f-4d62-48cf-a7ce-d14ec2051a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:15.503921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c58d8f-4d62-48cf-a7ce-d14ec2051a83 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:15.522113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:15.528564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc6e24-c461-4286-8d5d-a2c190e1fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:15.529442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc6e24-c461-4286-8d5d-a2c190e1fafa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.529892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc6e24-c461-4286-8d5d-a2c190e1fafa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.530366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc6e24-c461-4286-8d5d-a2c190e1fafa None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.532283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc6e24-c461-4286-8d5d-a2c190e1fafa None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:15.534406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc6e24-c461-4286-8d5d-a2c190e1fafa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:15.538455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 177/358] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:15 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:15.538455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eafa26-2b3f-4d0f-96de-7b795c48b5a8 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.539098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eafa26-2b3f-4d0f-96de-7b795c48b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.539522 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eafa26-2b3f-4d0f-96de-7b795c48b5a8 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.544906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 178/359] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:15.545891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eafa26-2b3f-4d0f-96de-7b795c48b5a8 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:15.625511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 182/360] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:15.627120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58d8f-4d62-48cf-a7ce-d14ec2051a83 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:15.651716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:15.706588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eafa26-2b3f-4d0f-96de-7b795c48b5a8 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:15.749559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c58d8f-4d62-48cf-a7ce-d14ec2051a83 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:15.756636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa723e-850a-4a7e-aa0d-f4533d8313e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:15.757254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa723e-850a-4a7e-aa0d-f4533d8313e7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.757527 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa723e-850a-4a7e-aa0d-f4533d8313e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.757840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa723e-850a-4a7e-aa0d-f4533d8313e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.758918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa723e-850a-4a7e-aa0d-f4533d8313e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:15.758918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa723e-850a-4a7e-aa0d-f4533d8313e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:15.760362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa723e-850a-4a7e-aa0d-f4533d8313e7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:15.769266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:15.770293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 179/361] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:15.771763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b399-80ba-4d03-bf2f-b33d9a016cfe None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.772193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b399-80ba-4d03-bf2f-b33d9a016cfe None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.777085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b399-80ba-4d03-bf2f-b33d9a016cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.791212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:15.791838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:15.792102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:15.792372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:15.793236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] RBAC: Adding query filter params (group.id=bbe0cdf741784d449cff6a36f68ab17b, role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=51900785ee9d499d9709cae42cfc5db2) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:15.793544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:15.795024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:15.798980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-01a3b399-80ba-4d03-bf2f-b33d9a016cfe None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:15.800463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-01a3b399-80ba-4d03-bf2f-b33d9a016cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:15.805160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 183/362] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:15 2022] GET /identity/v3/role_assignments?group.id=bbe0cdf741784d449cff6a36f68ab17b&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:15.806004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:15.915341 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 180/363] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:15.916523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3b399-80ba-4d03-bf2f-b33d9a016cfe None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:15.968047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caead9f2-7330-4b07-a105-2a1f2c21e061 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.023641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:16.042282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657911e8-d4f8-4ed6-a2b6-e44eda9a9ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:16.042920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657911e8-d4f8-4ed6-a2b6-e44eda9a9ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:16.043257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657911e8-d4f8-4ed6-a2b6-e44eda9a9ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:16.043504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657911e8-d4f8-4ed6-a2b6-e44eda9a9ca7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:16.068579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657911e8-d4f8-4ed6-a2b6-e44eda9a9ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-657911e8-d4f8-4ed6-a2b6-e44eda9a9ca7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:16.074320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:16.075214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:16.076033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 184/364] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:16.076735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657911e8-d4f8-4ed6-a2b6-e44eda9a9ca7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:16.100618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3b399-80ba-4d03-bf2f-b33d9a016cfe None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.121954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:16.180169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b0189-76e3-47fa-acfe-ea294e5aa5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:16.181163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b0189-76e3-47fa-acfe-ea294e5aa5bb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:16.181651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b0189-76e3-47fa-acfe-ea294e5aa5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:16.182181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b0189-76e3-47fa-acfe-ea294e5aa5bb None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:16.186638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b0189-76e3-47fa-acfe-ea294e5aa5bb None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:16.188433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b0189-76e3-47fa-acfe-ea294e5aa5bb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:16.190725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 181/365] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:15 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:16.191763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b0189-76e3-47fa-acfe-ea294e5aa5bb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:16.194175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657911e8-d4f8-4ed6-a2b6-e44eda9a9ca7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.238079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14069a-60eb-4f9f-89ef-27500d0406a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:16.238709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14069a-60eb-4f9f-89ef-27500d0406a0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:16.239019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14069a-60eb-4f9f-89ef-27500d0406a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:16.239291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14069a-60eb-4f9f-89ef-27500d0406a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:16.321858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14069a-60eb-4f9f-89ef-27500d0406a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:16.323411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14069a-60eb-4f9f-89ef-27500d0406a0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:16.361713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b0189-76e3-47fa-acfe-ea294e5aa5bb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.366887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:16.406004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:16.434389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:16.434389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:16.434389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:16.434389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:16.434755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:16.434755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:16.435101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:16.448442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:16.449062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:16.458230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 185/367] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:16.462597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14069a-60eb-4f9f-89ef-27500d0406a0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:16.587170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14069a-60eb-4f9f-89ef-27500d0406a0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.614721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba904d-1056-4c71-8149-7e8a85adbfb1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.636854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f459a-8ea5-4edb-8fed-d58782a24e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:16.638185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f459a-8ea5-4edb-8fed-d58782a24e2f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:16.638952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f459a-8ea5-4edb-8fed-d58782a24e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:16.639849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f459a-8ea5-4edb-8fed-d58782a24e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:16.649674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:16.654310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c898c-2b55-408b-9d51-8e322a662e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:16.655009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f459a-8ea5-4edb-8fed-d58782a24e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:16.655138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c898c-2b55-408b-9d51-8e322a662e39 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:16.655394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c898c-2b55-408b-9d51-8e322a662e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:16.655780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c898c-2b55-408b-9d51-8e322a662e39 None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:16.657505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c898c-2b55-408b-9d51-8e322a662e39 None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:16.659323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c898c-2b55-408b-9d51-8e322a662e39 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:16.662861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 183/368] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:16 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3f4f459a-8ea5-4edb-8fed-d58782a24e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:16.663065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:16.664132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:20:16.665143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:16.666494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c898c-2b55-408b-9d51-8e322a662e39 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:16.666624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 186/369] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:20:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:16.666624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f459a-8ea5-4edb-8fed-d58782a24e2f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:16.739813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:16.794710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f459a-8ea5-4edb-8fed-d58782a24e2f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.801630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c898c-2b55-408b-9d51-8e322a662e39 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.836132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fffff-223a-4ec5-b25a-e6023a5ff7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:16.836941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fffff-223a-4ec5-b25a-e6023a5ff7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:16.837332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fffff-223a-4ec5-b25a-e6023a5ff7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:16.837794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fffff-223a-4ec5-b25a-e6023a5ff7d0 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:16.840763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fffff-223a-4ec5-b25a-e6023a5ff7d0 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:16.842397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fffff-223a-4ec5-b25a-e6023a5ff7d0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:16.844480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 187/370] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:16 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:16.845777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fffff-223a-4ec5-b25a-e6023a5ff7d0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:16.847289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3435a81-0ee8-42e0-8f42-621f029a2803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:16.848088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435a81-0ee8-42e0-8f42-621f029a2803 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:16.848524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435a81-0ee8-42e0-8f42-621f029a2803 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:16.849236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3435a81-0ee8-42e0-8f42-621f029a2803 None admin] PATH_INFO: `/v3/users/88adc90dd21346439cd70fa9f3a6f365` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:16.851577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3435a81-0ee8-42e0-8f42-621f029a2803 None admin] RBAC: Authorizing `identity:get_user(user_id=88adc90dd21346439cd70fa9f3a6f365)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:16.853420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3435a81-0ee8-42e0-8f42-621f029a2803 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:16.855463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 184/371] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:20:16 2022] GET /identity/v3/users/88adc90dd21346439cd70fa9f3a6f365 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:16.856466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3435a81-0ee8-42e0-8f42-621f029a2803 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:16.941599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:16.982507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fffff-223a-4ec5-b25a-e6023a5ff7d0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:16.992000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3435a81-0ee8-42e0-8f42-621f029a2803 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:17.028105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:17.040497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:17.041092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:17.041540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.041918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.042134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.042418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.042707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.042909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.043731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:17.043887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] RBAC: Adding query filter params (group.id=bbe0cdf741784d449cff6a36f68ab17b, role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=52a1f0f883b14fd1832cf21670c5a803) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:17.044214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:17.044490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:17.046095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:17.046868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:17.053313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 188/372] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:16 2022] GET /identity/v3/role_assignments?group.id=bbe0cdf741784d449cff6a36f68ab17b&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:17.054368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:17.057674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 185/373] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:17.059262 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:17.187391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a636e-3e4d-410e-8764-c00881f03be9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:17.189890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9882a-df91-4e4f-9676-00c57b932a24 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:17.226011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:17.237252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be14609-563b-43da-91ca-ba69712a2f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:17.237470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd22830-e774-40f5-ad33-2587971a0222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:17.238284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14609-563b-43da-91ca-ba69712a2f38 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.241065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14609-563b-43da-91ca-ba69712a2f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.241065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be14609-563b-43da-91ca-ba69712a2f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.241065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be14609-563b-43da-91ca-ba69712a2f38 None admin] RBAC: Adding query filter params (role.id=b79d313a30ab46dca3bc5d0b3caca61a, user.id=88adc90dd21346439cd70fa9f3a6f365, scope.system=all) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:17.241065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be14609-563b-43da-91ca-ba69712a2f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:17.241524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22830-e774-40f5-ad33-2587971a0222 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.242419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22830-e774-40f5-ad33-2587971a0222 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.242528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be14609-563b-43da-91ca-ba69712a2f38 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:17.243559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22830-e774-40f5-ad33-2587971a0222 None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.245209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd22830-e774-40f5-ad33-2587971a0222 None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:17.246953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd22830-e774-40f5-ad33-2587971a0222 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:17.249728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 189/374] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:17 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:17.251433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd22830-e774-40f5-ad33-2587971a0222 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:17.258613 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 186/375] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Sep 22 14:20:17 2022] GET /identity/v3/role_assignments?user.id=88adc90dd21346439cd70fa9f3a6f365&scope.system=all&role.id=b79d313a30ab46dca3bc5d0b3caca61a => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:17.260042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04697-0f66-44fa-838b-5793ab3ab830 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.260417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04697-0f66-44fa-838b-5793ab3ab830 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.268143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc04697-0f66-44fa-838b-5793ab3ab830 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.268424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 187/376] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:17.269224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc04697-0f66-44fa-838b-5793ab3ab830 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:17.336949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:17.381623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd22830-e774-40f5-ad33-2587971a0222 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:17.428665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc04697-0f66-44fa-838b-5793ab3ab830 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:17.461357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034be802-e2a0-4fba-9279-1bda94af79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:17.462122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034be802-e2a0-4fba-9279-1bda94af79e5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.462401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034be802-e2a0-4fba-9279-1bda94af79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.462674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034be802-e2a0-4fba-9279-1bda94af79e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.505381 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afde9d7-f5d1-4b1e-8ec2-a4fa31468f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:17.505971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afde9d7-f5d1-4b1e-8ec2-a4fa31468f92 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.506279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afde9d7-f5d1-4b1e-8ec2-a4fa31468f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.506570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afde9d7-f5d1-4b1e-8ec2-a4fa31468f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.507299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afde9d7-f5d1-4b1e-8ec2-a4fa31468f92 None admin] RBAC: Adding query filter params (group.id=bbe0cdf741784d449cff6a36f68ab17b, role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=51900785ee9d499d9709cae42cfc5db2) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:17.507605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afde9d7-f5d1-4b1e-8ec2-a4fa31468f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:17.509032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afde9d7-f5d1-4b1e-8ec2-a4fa31468f92 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:17.515862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 188/377] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:17 2022] GET /identity/v3/role_assignments?group.id=bbe0cdf741784d449cff6a36f68ab17b&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:17.518122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40afc-bb51-442e-8a05-4669863d24f7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.518406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40afc-bb51-442e-8a05-4669863d24f7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.518675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d40afc-bb51-442e-8a05-4669863d24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.554404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:17.555100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a7d40afc-bb51-442e-8a05-4669863d24f7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:17.556569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a7d40afc-bb51-442e-8a05-4669863d24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:17.559019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034be802-e2a0-4fba-9279-1bda94af79e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:17.560735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034be802-e2a0-4fba-9279-1bda94af79e5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:17.696714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 190/378] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:17.702764 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034be802-e2a0-4fba-9279-1bda94af79e5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:17.703301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 189/379] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:17.848082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:17.853085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034be802-e2a0-4fba-9279-1bda94af79e5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:17.893761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b731-8c47-4d72-ba6e-00cabf4f7ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:17.894766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b731-8c47-4d72-ba6e-00cabf4f7ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:17.895246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b731-8c47-4d72-ba6e-00cabf4f7ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:17.895742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b731-8c47-4d72-ba6e-00cabf4f7ac1 None admin] PATH_INFO: `/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:17.897115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545b731-8c47-4d72-ba6e-00cabf4f7ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=f3670bb30aaf4bc3a00e3f65e0110ae7)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:17.898961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545b731-8c47-4d72-ba6e-00cabf4f7ac1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:17.901166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 191/380] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:17 2022] GET /identity/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:17.906447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d40afc-bb51-442e-8a05-4669863d24f7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:17.951723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:18.018815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b731-8c47-4d72-ba6e-00cabf4f7ac1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:18.056852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d40afc-bb51-442e-8a05-4669863d24f7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:18.144734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349448d-f729-4e09-9810-6f9160d3e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:18.145330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349448d-f729-4e09-9810-6f9160d3e3aa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:18.145610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349448d-f729-4e09-9810-6f9160d3e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:18.145884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349448d-f729-4e09-9810-6f9160d3e3aa None admin] PATH_INFO: `/v3/groups/71a4b09900924750bc0d880d2ff32544` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:18.168299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349448d-f729-4e09-9810-6f9160d3e3aa None admin] RBAC: Authorizing `identity:get_group(group_id=71a4b09900924750bc0d880d2ff32544)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:18.169797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349448d-f729-4e09-9810-6f9160d3e3aa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:18.174545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 190/381] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:17 2022] GET /identity/v3/groups/71a4b09900924750bc0d880d2ff32544 => generated 229 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:18.180245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349448d-f729-4e09-9810-6f9160d3e3aa None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:18.220948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b731-8c47-4d72-ba6e-00cabf4f7ac1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:18.297304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02e0f4-983b-4f9c-9960-45d44a2034d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:18.298707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02e0f4-983b-4f9c-9960-45d44a2034d3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:18.298991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02e0f4-983b-4f9c-9960-45d44a2034d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:18.299266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02e0f4-983b-4f9c-9960-45d44a2034d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:18.318890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02e0f4-983b-4f9c-9960-45d44a2034d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9d02e0f4-983b-4f9c-9960-45d44a2034d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:18.325231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:18.326189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:18.326993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:18.329813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 192/382] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:18.335909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02e0f4-983b-4f9c-9960-45d44a2034d3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:18.374268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349448d-f729-4e09-9810-6f9160d3e3aa None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:18.376669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:18.377024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:18.434500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:18.436115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:18.436543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:18.437245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:18.442595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] RBAC: Adding query filter params (group.id=71a4b09900924750bc0d880d2ff32544, role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=f3670bb30aaf4bc3a00e3f65e0110ae7) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:18.442914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:18.445245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:18.456660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 191/383] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:18 2022] GET /identity/v3/role_assignments?group.id=71a4b09900924750bc0d880d2ff32544&scope.project.id=f3670bb30aaf4bc3a00e3f65e0110ae7&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:18.471225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02e0f4-983b-4f9c-9960-45d44a2034d3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:18.512369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506718a7-6f5c-439d-81fd-a147eb326bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:18.512988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506718a7-6f5c-439d-81fd-a147eb326bdf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:18.513269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506718a7-6f5c-439d-81fd-a147eb326bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:18.513532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506718a7-6f5c-439d-81fd-a147eb326bdf None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:18.514238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506718a7-6f5c-439d-81fd-a147eb326bdf None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:18.514543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506718a7-6f5c-439d-81fd-a147eb326bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:18.515948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506718a7-6f5c-439d-81fd-a147eb326bdf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:18.526027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 193/384] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:18.533116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:18.627372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ee99-b824-404e-8708-4d3335215ce2 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:18.627707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ee99-b824-404e-8708-4d3335215ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:18.627924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2ee99-b824-404e-8708-4d3335215ce2 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:18.629808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 194/385] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:20:18.638015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025df9c-586a-494b-8f10-21be7ad4ea77 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:18.638015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025df9c-586a-494b-8f10-21be7ad4ea77 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:18.638015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025df9c-586a-494b-8f10-21be7ad4ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:18.658934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c025df9c-586a-494b-8f10-21be7ad4ea77 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:18.660571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c025df9c-586a-494b-8f10-21be7ad4ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:18.689373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd95e-9589-4265-85b3-e6d2fdf1945f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:18.753909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 195/386] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:18.762711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92978ec7-513b-42cc-a4d0-230b0f11d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:18.763367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978ec7-513b-42cc-a4d0-230b0f11d736 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:18.763647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978ec7-513b-42cc-a4d0-230b0f11d736 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:18.763926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978ec7-513b-42cc-a4d0-230b0f11d736 None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:18.765060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92978ec7-513b-42cc-a4d0-230b0f11d736 None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:18.767924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92978ec7-513b-42cc-a4d0-230b0f11d736 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:18.769732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 192/387] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:18 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:18.775403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025df9c-586a-494b-8f10-21be7ad4ea77 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:18.796172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:18.886900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025df9c-586a-494b-8f10-21be7ad4ea77 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:18.929114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a31ce-e6b4-424b-ba8e-53e8c4bba3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:18.929823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a31ce-e6b4-424b-ba8e-53e8c4bba3ad None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:18.930131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a31ce-e6b4-424b-ba8e-53e8c4bba3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:18.930401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a31ce-e6b4-424b-ba8e-53e8c4bba3ad None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:18.931559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a31ce-e6b4-424b-ba8e-53e8c4bba3ad None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:18.933071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a31ce-e6b4-424b-ba8e-53e8c4bba3ad None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:18.935054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 196/388] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:18 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:18.941818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92978ec7-513b-42cc-a4d0-230b0f11d736 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:18.998410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:19.093104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a31ce-e6b4-424b-ba8e-53e8c4bba3ad None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:19.100333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92978ec7-513b-42cc-a4d0-230b0f11d736 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:19.163728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b501d5-a9a0-4a4d-bf7e-bf6f32a3985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:19.164402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b501d5-a9a0-4a4d-bf7e-bf6f32a3985d None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:19.164678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b501d5-a9a0-4a4d-bf7e-bf6f32a3985d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:19.164962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b501d5-a9a0-4a4d-bf7e-bf6f32a3985d None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803/groups/bbe0cdf741784d449cff6a36f68ab17b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:19.171302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b501d5-a9a0-4a4d-bf7e-bf6f32a3985d None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1f0f883b14fd1832cf21670c5a803, group_id=bbe0cdf741784d449cff6a36f68ab17b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:19.173327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b501d5-a9a0-4a4d-bf7e-bf6f32a3985d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:19.213935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:19.227297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a31ce-e6b4-424b-ba8e-53e8c4bba3ad None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:19.270757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29212-605d-4590-89d2-c818c8e843a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:19.271399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29212-605d-4590-89d2-c818c8e843a9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:19.271677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29212-605d-4590-89d2-c818c8e843a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:19.271950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29212-605d-4590-89d2-c818c8e843a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:19.294243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 193/389] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 22 14:20:18 2022] PUT /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803/groups/bbe0cdf741784d449cff6a36f68ab17b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:19.295496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b29212-605d-4590-89d2-c818c8e843a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-54b29212-605d-4590-89d2-c818c8e843a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:19.301073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:19.302516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:19.303322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:19.308529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b501d5-a9a0-4a4d-bf7e-bf6f32a3985d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:19.310360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 197/390] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:19.452893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:19.462766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b501d5-a9a0-4a4d-bf7e-bf6f32a3985d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:19.511510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:19.512161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:19.512437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:19.512704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:19.513382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:19.513682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:19.515085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:19.527188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 194/391] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:19.533218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29212-605d-4590-89d2-c818c8e843a9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:19.685756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29212-605d-4590-89d2-c818c8e843a9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:19.738007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a759-bac2-4db8-87fa-4789fbdce60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:19.738007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a759-bac2-4db8-87fa-4789fbdce60d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:19.738274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a759-bac2-4db8-87fa-4789fbdce60d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:19.738379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807a759-bac2-4db8-87fa-4789fbdce60d None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:19.741057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807a759-bac2-4db8-87fa-4789fbdce60d None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:19.742655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807a759-bac2-4db8-87fa-4789fbdce60d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:19.744894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 198/392] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:19 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:19.750571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:19.897791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade038e-42c9-47e1-a6dc-0a6aa391b2a8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:19.941742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b4c39-8353-4b1d-81bb-d601d466a023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:19.942414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b4c39-8353-4b1d-81bb-d601d466a023 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:19.942693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b4c39-8353-4b1d-81bb-d601d466a023 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:19.942968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b4c39-8353-4b1d-81bb-d601d466a023 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:19.944563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b4c39-8353-4b1d-81bb-d601d466a023 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:19.946114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b4c39-8353-4b1d-81bb-d601d466a023 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:19.948146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 195/393] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:19 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:19.954497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a759-bac2-4db8-87fa-4789fbdce60d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:19.989717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:20.101828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807a759-bac2-4db8-87fa-4789fbdce60d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:20.155362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a4e7d-2914-4ad5-967e-bb5f077c9b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:20.155948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4e7d-2914-4ad5-967e-bb5f077c9b45 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:20.156221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4e7d-2914-4ad5-967e-bb5f077c9b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:20.156492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4e7d-2914-4ad5-967e-bb5f077c9b45 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2/groups/bbe0cdf741784d449cff6a36f68ab17b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:20.163373 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a4e7d-2914-4ad5-967e-bb5f077c9b45 None admin] RBAC: Authorizing `identity:create_grant(project_id=51900785ee9d499d9709cae42cfc5db2, group_id=bbe0cdf741784d449cff6a36f68ab17b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:20.164829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a4e7d-2914-4ad5-967e-bb5f077c9b45 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:20.168916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2b293-60a9-4d71-be93-61a1735f4aaf None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:20.169201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2b293-60a9-4d71-be93-61a1735f4aaf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:20.169479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2b293-60a9-4d71-be93-61a1735f4aaf None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:20.171092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 196/394] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:20.181232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bbbe-2cca-4d22-b9f6-a548b4cce81e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:20.181616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bbbe-2cca-4d22-b9f6-a548b4cce81e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:20.181910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bbbe-2cca-4d22-b9f6-a548b4cce81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:20.205438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d064bbbe-2cca-4d22-b9f6-a548b4cce81e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:20.206721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d064bbbe-2cca-4d22-b9f6-a548b4cce81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:20.240180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:20.244549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 199/395] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 22 14:20:19 2022] PUT /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2/groups/bbe0cdf741784d449cff6a36f68ab17b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:20.314087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 197/396] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:20.574100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244fee-e3bf-4372-9087-442bbf4ed818 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:20.574642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244fee-e3bf-4372-9087-442bbf4ed818 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:20.574642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244fee-e3bf-4372-9087-442bbf4ed818 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:20.576412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 200/397] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:20.587940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ed3a-fcf8-4660-88da-e5489291f494 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:20.588472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ed3a-fcf8-4660-88da-e5489291f494 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:20.588472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ed3a-fcf8-4660-88da-e5489291f494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:20.610217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-82c3ed3a-fcf8-4660-88da-e5489291f494 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:20.611426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-82c3ed3a-fcf8-4660-88da-e5489291f494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:20.689911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 198/398] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:20.810895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244fee-e3bf-4372-9087-442bbf4ed818 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:20.910580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:20.938644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244fee-e3bf-4372-9087-442bbf4ed818 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:20.982377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32452ef-0706-45ba-9cf0-df3eb9d7d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:20.983014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32452ef-0706-45ba-9cf0-df3eb9d7d97e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:20.983289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32452ef-0706-45ba-9cf0-df3eb9d7d97e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:20.983556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32452ef-0706-45ba-9cf0-df3eb9d7d97e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:20.996193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32452ef-0706-45ba-9cf0-df3eb9d7d97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b32452ef-0706-45ba-9cf0-df3eb9d7d97e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:21.001696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:21.002612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:21.003403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 201/399] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:20:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:21.013158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ed3a-fcf8-4660-88da-e5489291f494 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:21.123465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:21.144107 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32452ef-0706-45ba-9cf0-df3eb9d7d97e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:21.147660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ed3a-fcf8-4660-88da-e5489291f494 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:21.186099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:21.187418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.187700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.188000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.188684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:21.189063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:21.190459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:21.201103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 199/400] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:21.208409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:21.303032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32452ef-0706-45ba-9cf0-df3eb9d7d97e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:21.357917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7670e2-59da-4cc1-b064-8ddd52884bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:21.358578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7670e2-59da-4cc1-b064-8ddd52884bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.358854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7670e2-59da-4cc1-b064-8ddd52884bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.359123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7670e2-59da-4cc1-b064-8ddd52884bc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.361710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:21.374505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7670e2-59da-4cc1-b064-8ddd52884bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-4a7670e2-59da-4cc1-b064-8ddd52884bc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:21.380884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:21.381814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:21.382720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:21.385612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 202/401] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:20:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:21.386984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a7fe7-4036-482a-abc8-0aa06a066baf None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.387457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a7fe7-4036-482a-abc8-0aa06a066baf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.387986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a7fe7-4036-482a-abc8-0aa06a066baf None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.389829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 203/402] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:21.394330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a7fe7-4036-482a-abc8-0aa06a066baf None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:21.408344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912d39-5971-4a54-8218-8a86b00f43c8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:21.443558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eda298-b391-4304-8441-1b3ef807c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:21.444621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eda298-b391-4304-8441-1b3ef807c33f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.445045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eda298-b391-4304-8441-1b3ef807c33f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.445457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eda298-b391-4304-8441-1b3ef807c33f None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.446794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eda298-b391-4304-8441-1b3ef807c33f None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:21.448420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eda298-b391-4304-8441-1b3ef807c33f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:21.450807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:21 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:21.457191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12d6f9-de2a-4da7-b22f-4b9462428036 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.457652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12d6f9-de2a-4da7-b22f-4b9462428036 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.458097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12d6f9-de2a-4da7-b22f-4b9462428036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.476891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3d12d6f9-de2a-4da7-b22f-4b9462428036 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:21.478650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3d12d6f9-de2a-4da7-b22f-4b9462428036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:21.505232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a7fe7-4036-482a-abc8-0aa06a066baf None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:21.530376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:21.541392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:21.542035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.542316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.543814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.543814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:21.543814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:21.544946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:21.552110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 201/404] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:21.553235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12d6f9-de2a-4da7-b22f-4b9462428036 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:21.560324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 204/405] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:21.566222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:21.684666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:21.713071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12d6f9-de2a-4da7-b22f-4b9462428036 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:21.746994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1562504-4d53-47a5-8553-aedc30718ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:21.748022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562504-4d53-47a5-8553-aedc30718ada None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.748503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562504-4d53-47a5-8553-aedc30718ada None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.748989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1562504-4d53-47a5-8553-aedc30718ada None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.751087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1562504-4d53-47a5-8553-aedc30718ada None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:21.752833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1562504-4d53-47a5-8553-aedc30718ada None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:21.755129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 202/406] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:21 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:21.760939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1562504-4d53-47a5-8553-aedc30718ada None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:21.774914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:21.823134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ef472-27cc-440d-8552-7c585c1cd49b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:21.882996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e4c24-ed52-486a-8e94-1cecc8b50d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:21.883382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1562504-4d53-47a5-8553-aedc30718ada None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:21.883637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e4c24-ed52-486a-8e94-1cecc8b50d4c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.883916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e4c24-ed52-486a-8e94-1cecc8b50d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.884191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e4c24-ed52-486a-8e94-1cecc8b50d4c None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.885377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e4c24-ed52-486a-8e94-1cecc8b50d4c None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:21.886964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e4c24-ed52-486a-8e94-1cecc8b50d4c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:21.893360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 205/407] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:21 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:21.894272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e4c24-ed52-486a-8e94-1cecc8b50d4c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:21.925427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e80b0-22b8-49ae-b8f4-3fd66cb06f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:21.926327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e80b0-22b8-49ae-b8f4-3fd66cb06f67 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:21.926611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e80b0-22b8-49ae-b8f4-3fd66cb06f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:21.927202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e80b0-22b8-49ae-b8f4-3fd66cb06f67 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803/groups/bbe0cdf741784d449cff6a36f68ab17b/roles/6ab17e0fb4c647c690842276bdf39eeb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:21.930139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e80b0-22b8-49ae-b8f4-3fd66cb06f67 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1f0f883b14fd1832cf21670c5a803, group_id=bbe0cdf741784d449cff6a36f68ab17b, role_id=6ab17e0fb4c647c690842276bdf39eeb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:21.931970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e80b0-22b8-49ae-b8f4-3fd66cb06f67 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:22.001098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e4c24-ed52-486a-8e94-1cecc8b50d4c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:22.022164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 203/408] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 22 14:20:21 2022] PUT /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803/groups/bbe0cdf741784d449cff6a36f68ab17b/roles/6ab17e0fb4c647c690842276bdf39eeb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:20:22.022164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e80b0-22b8-49ae-b8f4-3fd66cb06f67 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:22.048915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:22.067714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d092-f096-46fe-bd8d-6a4022badd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:22.068371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d092-f096-46fe-bd8d-6a4022badd73 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.068652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d092-f096-46fe-bd8d-6a4022badd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.068922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d092-f096-46fe-bd8d-6a4022badd73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.095612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370d092-f096-46fe-bd8d-6a4022badd73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9370d092-f096-46fe-bd8d-6a4022badd73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:22.101312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:22.102351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:22.103453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 206/409] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:22.108788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d092-f096-46fe-bd8d-6a4022badd73 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:22.187787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:22.252369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e80b0-22b8-49ae-b8f4-3fd66cb06f67 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:22.295587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d092-f096-46fe-bd8d-6a4022badd73 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:22.307729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234de7a7-8c2c-4480-89ae-24e740620853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:22.308738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de7a7-8c2c-4480-89ae-24e740620853 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.309148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de7a7-8c2c-4480-89ae-24e740620853 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.309615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234de7a7-8c2c-4480-89ae-24e740620853 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.310935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234de7a7-8c2c-4480-89ae-24e740620853 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:22.312521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234de7a7-8c2c-4480-89ae-24e740620853 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:22.315294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 204/410] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:22 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:22.316725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e944f-5ef1-40bf-8b0e-e9769f58d885 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.317206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e944f-5ef1-40bf-8b0e-e9769f58d885 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.317686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e944f-5ef1-40bf-8b0e-e9769f58d885 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.319402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 205/411] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:22.320575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e944f-5ef1-40bf-8b0e-e9769f58d885 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:22.335609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e36d59-d33a-45b3-a3ce-511309e42172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:22.336258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36d59-d33a-45b3-a3ce-511309e42172 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.336533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36d59-d33a-45b3-a3ce-511309e42172 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.336846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e36d59-d33a-45b3-a3ce-511309e42172 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.337565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e36d59-d33a-45b3-a3ce-511309e42172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:22.337869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e36d59-d33a-45b3-a3ce-511309e42172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:22.339529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e36d59-d33a-45b3-a3ce-511309e42172 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:22.349486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 207/412] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:22.350814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121e80b-beed-45cd-96cd-0d18c274e992 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.351100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121e80b-beed-45cd-96cd-0d18c274e992 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.351411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121e80b-beed-45cd-96cd-0d18c274e992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.370440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0121e80b-beed-45cd-96cd-0d18c274e992 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:22.371542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0121e80b-beed-45cd-96cd-0d18c274e992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:22.417670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:22.434194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e944f-5ef1-40bf-8b0e-e9769f58d885 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:22.443093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 208/413] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:22.443927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121e80b-beed-45cd-96cd-0d18c274e992 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:22.496245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8718-47d2-4271-a768-906434cb4522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:22.496919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8718-47d2-4271-a768-906434cb4522 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.497193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8718-47d2-4271-a768-906434cb4522 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.497458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8718-47d2-4271-a768-906434cb4522 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2/groups/bbe0cdf741784d449cff6a36f68ab17b/roles/6ab17e0fb4c647c690842276bdf39eeb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.503240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d8718-47d2-4271-a768-906434cb4522 None admin] RBAC: Authorizing `identity:create_grant(project_id=51900785ee9d499d9709cae42cfc5db2, group_id=bbe0cdf741784d449cff6a36f68ab17b, role_id=6ab17e0fb4c647c690842276bdf39eeb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:22.504636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d8718-47d2-4271-a768-906434cb4522 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:22.581692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:22.586734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 206/414] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 22 14:20:22 2022] PUT /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2/groups/bbe0cdf741784d449cff6a36f68ab17b/roles/6ab17e0fb4c647c690842276bdf39eeb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:22.590762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121e80b-beed-45cd-96cd-0d18c274e992 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:22.657950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ddc68-5279-4e78-aa34-4af35c5f980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:22.658642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ddc68-5279-4e78-aa34-4af35c5f980b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.658980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ddc68-5279-4e78-aa34-4af35c5f980b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.659252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ddc68-5279-4e78-aa34-4af35c5f980b None admin] PATH_INFO: `/v3/groups/71a4b09900924750bc0d880d2ff32544` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.660524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ddc68-5279-4e78-aa34-4af35c5f980b None admin] RBAC: Authorizing `identity:get_group(group_id=71a4b09900924750bc0d880d2ff32544)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:22.662099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ddc68-5279-4e78-aa34-4af35c5f980b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:22.664042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 209/415] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:22 2022] GET /identity/v3/groups/71a4b09900924750bc0d880d2ff32544 => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:22.669836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8718-47d2-4271-a768-906434cb4522 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:22.764100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ddc68-5279-4e78-aa34-4af35c5f980b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:22.816228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8718-47d2-4271-a768-906434cb4522 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:22.818500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:22.877898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806e2e-99b7-4306-a823-203034ed257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:22.878608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806e2e-99b7-4306-a823-203034ed257c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.878891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806e2e-99b7-4306-a823-203034ed257c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.879170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e806e2e-99b7-4306-a823-203034ed257c None admin] PATH_INFO: `/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.881802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e806e2e-99b7-4306-a823-203034ed257c None admin] RBAC: Authorizing `identity:get_project(project_id=f3670bb30aaf4bc3a00e3f65e0110ae7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:22.883563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e806e2e-99b7-4306-a823-203034ed257c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:22.889922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 207/416] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:22 2022] GET /identity/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:22.891198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806e2e-99b7-4306-a823-203034ed257c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:22.892076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ddc68-5279-4e78-aa34-4af35c5f980b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:22.935014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b201-51e7-41ba-868e-a8204a1df52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:22.935655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b201-51e7-41ba-868e-a8204a1df52e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:22.935933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b201-51e7-41ba-868e-a8204a1df52e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:22.936204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6b201-51e7-41ba-868e-a8204a1df52e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:22.958643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6b201-51e7-41ba-868e-a8204a1df52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-95f6b201-51e7-41ba-868e-a8204a1df52e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:22.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:22.964622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:22.965578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 210/417] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:22.974932 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b201-51e7-41ba-868e-a8204a1df52e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:22.975684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:23.032500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e806e2e-99b7-4306-a823-203034ed257c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:23.103571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697f4a-fef4-4731-bf9b-c24f8c9e7b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:23.104263 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697f4a-fef4-4731-bf9b-c24f8c9e7b03 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:23.104538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697f4a-fef4-4731-bf9b-c24f8c9e7b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:23.104808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697f4a-fef4-4731-bf9b-c24f8c9e7b03 None admin] PATH_INFO: `/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7/groups/71a4b09900924750bc0d880d2ff32544/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:23.109151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25697f4a-fef4-4731-bf9b-c24f8c9e7b03 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3670bb30aaf4bc3a00e3f65e0110ae7, group_id=71a4b09900924750bc0d880d2ff32544, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:23.111351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25697f4a-fef4-4731-bf9b-c24f8c9e7b03 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:23.152015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6b201-51e7-41ba-868e-a8204a1df52e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:23.166393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:23.197620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 208/418] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 22 14:20:22 2022] PUT /identity/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7/groups/71a4b09900924750bc0d880d2ff32544/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:20:23.197826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3437e1b-dfc8-4941-bef1-10333e13841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:23.198456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3437e1b-dfc8-4941-bef1-10333e13841a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:23.203523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3437e1b-dfc8-4941-bef1-10333e13841a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:23.204022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3437e1b-dfc8-4941-bef1-10333e13841a None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:23.204915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3437e1b-dfc8-4941-bef1-10333e13841a None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:23.205223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3437e1b-dfc8-4941-bef1-10333e13841a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:23.206708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3437e1b-dfc8-4941-bef1-10333e13841a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:23.216151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 211/419] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:23.222261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697f4a-fef4-4731-bf9b-c24f8c9e7b03 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:23.246287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d398bf-e11e-4dcd-ad26-41b5d200428b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:23.246574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d398bf-e11e-4dcd-ad26-41b5d200428b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:23.246846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d398bf-e11e-4dcd-ad26-41b5d200428b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:23.249746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 212/420] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:23.256795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410984e-250a-4d81-a390-7c931c6f2750 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:23.257127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410984e-250a-4d81-a390-7c931c6f2750 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:23.257348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410984e-250a-4d81-a390-7c931c6f2750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:23.284245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e410984e-250a-4d81-a390-7c931c6f2750 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:23.285399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e410984e-250a-4d81-a390-7c931c6f2750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:23.379770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 213/421] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:23.421793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697f4a-fef4-4731-bf9b-c24f8c9e7b03 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:23.451393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:23.463361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26906-92c4-489a-b497-ff1cc12bb91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:23.466902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26906-92c4-489a-b497-ff1cc12bb91f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:23.466902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26906-92c4-489a-b497-ff1cc12bb91f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:23.466902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26906-92c4-489a-b497-ff1cc12bb91f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:23.534810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf26906-92c4-489a-b497-ff1cc12bb91f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:23.536259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf26906-92c4-489a-b497-ff1cc12bb91f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:23.639281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 209/422] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:23.644593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410984e-250a-4d81-a390-7c931c6f2750 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:23.719874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26906-92c4-489a-b497-ff1cc12bb91f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:23.772341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:23.779034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410984e-250a-4d81-a390-7c931c6f2750 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:23.787165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:23.859632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5e4f8-f4e9-4576-813b-e6fc7934b017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:23.860519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e4f8-f4e9-4576-813b-e6fc7934b017 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:23.860797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e4f8-f4e9-4576-813b-e6fc7934b017 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:23.861070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e4f8-f4e9-4576-813b-e6fc7934b017 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:23.861410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26906-92c4-489a-b497-ff1cc12bb91f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:23.866661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5e4f8-f4e9-4576-813b-e6fc7934b017 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:23.868096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5e4f8-f4e9-4576-813b-e6fc7934b017 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:23.869903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 214/423] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:23 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:23.877155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5e4f8-f4e9-4576-813b-e6fc7934b017 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:23.954916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ed4ef-b304-407b-abc6-d615a2b7756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:23.955578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed4ef-b304-407b-abc6-d615a2b7756a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:23.955860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed4ef-b304-407b-abc6-d615a2b7756a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:23.956137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed4ef-b304-407b-abc6-d615a2b7756a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:23.976226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ed4ef-b304-407b-abc6-d615a2b7756a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-772ed4ef-b304-407b-abc6-d615a2b7756a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:23.981440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:23.982394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 22 14:20:23.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:23.994990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 210/424] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:24.006973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ed4ef-b304-407b-abc6-d615a2b7756a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:24.008534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5e4f8-f4e9-4576-813b-e6fc7934b017 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:24.065136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295ceb-f885-4834-8013-ca5f0c9820ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:24.065684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295ceb-f885-4834-8013-ca5f0c9820ff None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:24.065960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295ceb-f885-4834-8013-ca5f0c9820ff None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:24.066256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295ceb-f885-4834-8013-ca5f0c9820ff None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:24.069136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79295ceb-f885-4834-8013-ca5f0c9820ff None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:24.070611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79295ceb-f885-4834-8013-ca5f0c9820ff None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:24.072183 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 215/425] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:23 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:24.082906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295ceb-f885-4834-8013-ca5f0c9820ff None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:24.116806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:24.174969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:24.195057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295ceb-f885-4834-8013-ca5f0c9820ff None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:24.203535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ed4ef-b304-407b-abc6-d615a2b7756a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:24.257141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa16d73-1756-466e-bba8-4136d0f01af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:24.258048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa16d73-1756-466e-bba8-4136d0f01af0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:24.258501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa16d73-1756-466e-bba8-4136d0f01af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:24.258943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa16d73-1756-466e-bba8-4136d0f01af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:24.259838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa16d73-1756-466e-bba8-4136d0f01af0 None admin] RBAC: Adding query filter params (group.id=bbe0cdf741784d449cff6a36f68ab17b, role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=52a1f0f883b14fd1832cf21670c5a803) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:24.260341 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:24.260461 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa16d73-1756-466e-bba8-4136d0f01af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:24.261061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:24.261403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:24.261739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:24.262543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] RBAC: Adding query filter params (name=member) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:24.262850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa16d73-1756-466e-bba8-4136d0f01af0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:24.262948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:24.264326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:24.278201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 211/426] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:20:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:24.279219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 216/427] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:24 2022] GET /identity/v3/role_assignments?group.id=bbe0cdf741784d449cff6a36f68ab17b&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:24.279890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:24.463998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df08d-9ea5-43d5-af4b-20575374097a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:24.514431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b74c-4d42-4eef-8c5b-7407f2984184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:24.515062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b74c-4d42-4eef-8c5b-7407f2984184 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:24.515346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b74c-4d42-4eef-8c5b-7407f2984184 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:24.515621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b74c-4d42-4eef-8c5b-7407f2984184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:24.544134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:24.600883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824b74c-4d42-4eef-8c5b-7407f2984184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:24.602448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824b74c-4d42-4eef-8c5b-7407f2984184 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:24.691582 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfd70f-f4b9-4f74-b158-22de56fb39c2 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:24.691966 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfd70f-f4b9-4f74-b158-22de56fb39c2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:24.692249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfd70f-f4b9-4f74-b158-22de56fb39c2 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:24.695053 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 217/428] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:24.699410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6746-7a3f-4619-9689-f86518ee36d7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:24.699702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6746-7a3f-4619-9689-f86518ee36d7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:24.699980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6746-7a3f-4619-9689-f86518ee36d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:24.705813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 212/429] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:24.713843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b74c-4d42-4eef-8c5b-7407f2984184 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:24.729687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-55eb6746-7a3f-4619-9689-f86518ee36d7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:24.730991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55eb6746-7a3f-4619-9689-f86518ee36d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:24.767345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:24.841348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 218/430] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:24.847879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b74c-4d42-4eef-8c5b-7407f2984184 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:24.885201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7dcf4-48b0-4752-9526-d62d556f16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:24.885831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7dcf4-48b0-4752-9526-d62d556f16d7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:24.886123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7dcf4-48b0-4752-9526-d62d556f16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:24.886397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7dcf4-48b0-4752-9526-d62d556f16d7 None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:24.887544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7dcf4-48b0-4752-9526-d62d556f16d7 None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:24.888977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7dcf4-48b0-4752-9526-d62d556f16d7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:24.891068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 213/431] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:24 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:24.897397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6746-7a3f-4619-9689-f86518ee36d7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:24.934377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:25.002322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6746-7a3f-4619-9689-f86518ee36d7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:25.038074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b76f5-b85a-43e3-9b7b-608f33715b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:25.038760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b76f5-b85a-43e3-9b7b-608f33715b26 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:25.039040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b76f5-b85a-43e3-9b7b-608f33715b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:25.039310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b76f5-b85a-43e3-9b7b-608f33715b26 None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:25.040452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b76f5-b85a-43e3-9b7b-608f33715b26 None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:25.041944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b76f5-b85a-43e3-9b7b-608f33715b26 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:25.043822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 219/432] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:24 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:25.050285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7dcf4-48b0-4752-9526-d62d556f16d7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:25.174892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b76f5-b85a-43e3-9b7b-608f33715b26 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:25.193744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7dcf4-48b0-4752-9526-d62d556f16d7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:25.213664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:25.236274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fde8b1-1b77-4e24-a2c6-0bbfef8087ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:25.236895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fde8b1-1b77-4e24-a2c6-0bbfef8087ad None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:25.237170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fde8b1-1b77-4e24-a2c6-0bbfef8087ad None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:25.237438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fde8b1-1b77-4e24-a2c6-0bbfef8087ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:25.240833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fde8b1-1b77-4e24-a2c6-0bbfef8087ad None admin] RBAC: Adding query filter params (group.id=bbe0cdf741784d449cff6a36f68ab17b, role.id=2be9f83593d64e6ea6877bccf0dda44c, scope.project.id=51900785ee9d499d9709cae42cfc5db2) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:25.240833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fde8b1-1b77-4e24-a2c6-0bbfef8087ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:25.240833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fde8b1-1b77-4e24-a2c6-0bbfef8087ad None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:25.246884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 214/433] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:25 2022] GET /identity/v3/role_assignments?group.id=bbe0cdf741784d449cff6a36f68ab17b&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=2be9f83593d64e6ea6877bccf0dda44c => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:25.278214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c2c24-c6b6-4ff1-8ef8-d5939e8cd861 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:25.278559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c2c24-c6b6-4ff1-8ef8-d5939e8cd861 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:25.279037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c2c24-c6b6-4ff1-8ef8-d5939e8cd861 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:25.281058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 215/434] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:25.287546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a960c-0a36-4e05-b417-5c0acc0c430d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:25.287972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a960c-0a36-4e05-b417-5c0acc0c430d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:25.288347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a960c-0a36-4e05-b417-5c0acc0c430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:25.305245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:25.310092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f72a960c-0a36-4e05-b417-5c0acc0c430d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:25.311303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f72a960c-0a36-4e05-b417-5c0acc0c430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:25.313822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b76f5-b85a-43e3-9b7b-608f33715b26 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:25.352192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d2641-2c5c-4a76-a0e4-fd909d1bff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:25.353478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d2641-2c5c-4a76-a0e4-fd909d1bff48 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:25.354041 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d2641-2c5c-4a76-a0e4-fd909d1bff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:25.354551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d2641-2c5c-4a76-a0e4-fd909d1bff48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:25.367017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d2641-2c5c-4a76-a0e4-fd909d1bff48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-075d2641-2c5c-4a76-a0e4-fd909d1bff48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:25.372346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:25.373460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:25.374294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:25.377614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 220/435] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:20:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:25.384669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d2641-2c5c-4a76-a0e4-fd909d1bff48 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:25.399523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 216/436] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:25.496187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d2641-2c5c-4a76-a0e4-fd909d1bff48 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:25.531500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:25.532563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:25.533014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:25.533451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:25.534312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:25.534785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:25.536419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:25.544988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 221/437] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:25.551621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a960c-0a36-4e05-b417-5c0acc0c430d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:25.655161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a960c-0a36-4e05-b417-5c0acc0c430d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:25.666126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:25.689416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744db6-82ef-4b4d-8122-3e77d80f18cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:25.690118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744db6-82ef-4b4d-8122-3e77d80f18cc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:25.690439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744db6-82ef-4b4d-8122-3e77d80f18cc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:25.690713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744db6-82ef-4b4d-8122-3e77d80f18cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:25.712905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:25.733699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:25.765298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52744db6-82ef-4b4d-8122-3e77d80f18cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:25.766923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52744db6-82ef-4b4d-8122-3e77d80f18cc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:25.829408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0c0fa-a62c-4156-a9cc-7991d3dc68dc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:25.866608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61264e59-0a49-452a-9b59-00946e8a8cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:25.867234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264e59-0a49-452a-9b59-00946e8a8cdc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:25.867500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264e59-0a49-452a-9b59-00946e8a8cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:25.867773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264e59-0a49-452a-9b59-00946e8a8cdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:25.872942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 217/438] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:25.879180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744db6-82ef-4b4d-8122-3e77d80f18cc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:25.884356 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61264e59-0a49-452a-9b59-00946e8a8cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-61264e59-0a49-452a-9b59-00946e8a8cdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:25.889668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:25.890567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:25.891709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 222/439] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:20:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:25.894281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:25.896819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61264e59-0a49-452a-9b59-00946e8a8cdc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:25.975871 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:25.982695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744db6-82ef-4b4d-8122-3e77d80f18cc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:25.999206 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61264e59-0a49-452a-9b59-00946e8a8cdc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.016543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f8caf-c61c-474c-aa3b-0638f94074e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.017163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f8caf-c61c-474c-aa3b-0638f94074e5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.017444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f8caf-c61c-474c-aa3b-0638f94074e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.017706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f8caf-c61c-474c-aa3b-0638f94074e5 None admin] PATH_INFO: `/v3/projects/52a1f0f883b14fd1832cf21670c5a803` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.018840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f8caf-c61c-474c-aa3b-0638f94074e5 None admin] RBAC: Authorizing `identity:get_project(project_id=52a1f0f883b14fd1832cf21670c5a803)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.020272 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f8caf-c61c-474c-aa3b-0638f94074e5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.021866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 218/440] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:25 2022] GET /identity/v3/projects/52a1f0f883b14fd1832cf21670c5a803 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:26.026758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa6137-6aa1-461a-abd7-c05e49783a68 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.027046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa6137-6aa1-461a-abd7-c05e49783a68 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.027321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa6137-6aa1-461a-abd7-c05e49783a68 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.029670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 219/441] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:26.029670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa6137-6aa1-461a-abd7-c05e49783a68 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.035435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8307e3-eca0-448d-b2b0-0a6694b51262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.036044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8307e3-eca0-448d-b2b0-0a6694b51262 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.036326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8307e3-eca0-448d-b2b0-0a6694b51262 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.036597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8307e3-eca0-448d-b2b0-0a6694b51262 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.037262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8307e3-eca0-448d-b2b0-0a6694b51262 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:26.037567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8307e3-eca0-448d-b2b0-0a6694b51262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.038979 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8307e3-eca0-448d-b2b0-0a6694b51262 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.048563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 223/442] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:26.049777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739cce-8efa-486a-9621-1084515870cf None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.050140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739cce-8efa-486a-9621-1084515870cf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.050421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95739cce-8efa-486a-9621-1084515870cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.068942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-95739cce-8efa-486a-9621-1084515870cf None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:26.070165 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-95739cce-8efa-486a-9621-1084515870cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:26.113511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:26.136087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa6137-6aa1-461a-abd7-c05e49783a68 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.136482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 224/443] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:26.137295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739cce-8efa-486a-9621-1084515870cf None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.189241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9da52b-129d-4380-85cc-bc8bc62ffc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.189869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9da52b-129d-4380-85cc-bc8bc62ffc61 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.190176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9da52b-129d-4380-85cc-bc8bc62ffc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.190443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9da52b-129d-4380-85cc-bc8bc62ffc61 None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.191550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9da52b-129d-4380-85cc-bc8bc62ffc61 None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.192980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9da52b-129d-4380-85cc-bc8bc62ffc61 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.194544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 220/444] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:26.200156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9da52b-129d-4380-85cc-bc8bc62ffc61 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.207109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:26.243164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95739cce-8efa-486a-9621-1084515870cf None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.279199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7e8b9-9d3b-40f4-9969-cbac71a05437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.279935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e8b9-9d3b-40f4-9969-cbac71a05437 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.280278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e8b9-9d3b-40f4-9969-cbac71a05437 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.280626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7e8b9-9d3b-40f4-9969-cbac71a05437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.310260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9da52b-129d-4380-85cc-bc8bc62ffc61 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.348873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.349746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.350121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.350942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.351682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] RBAC: Adding query filter params (group.id=bbe0cdf741784d449cff6a36f68ab17b, role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=52a1f0f883b14fd1832cf21670c5a803) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:26.351994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.353063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7e8b9-9d3b-40f4-9969-cbac71a05437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.353679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.354548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7e8b9-9d3b-40f4-9969-cbac71a05437 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.362550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 221/445] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/role_assignments?group.id=bbe0cdf741784d449cff6a36f68ab17b&scope.project.id=52a1f0f883b14fd1832cf21670c5a803&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:26.424491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.435712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:26.437693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:26.473154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 225/446] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:26.479330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7e8b9-9d3b-40f4-9969-cbac71a05437 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.550686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfa1be-4311-481c-b7e9-fb3383178ea8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.596741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f344c-1435-43fc-b71e-4d865c38c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.597378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f344c-1435-43fc-b71e-4d865c38c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.597656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f344c-1435-43fc-b71e-4d865c38c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.597928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f344c-1435-43fc-b71e-4d865c38c1b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.598083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7e8b9-9d3b-40f4-9969-cbac71a05437 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.609970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f344c-1435-43fc-b71e-4d865c38c1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-b63f344c-1435-43fc-b71e-4d865c38c1b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:26.616900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:26.617816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:26.618657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 222/447] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:26.624760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f344c-1435-43fc-b71e-4d865c38c1b3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.645006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712297-cf03-4445-9035-323f577f7c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.645660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712297-cf03-4445-9035-323f577f7c8b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.645923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712297-cf03-4445-9035-323f577f7c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.646242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712297-cf03-4445-9035-323f577f7c8b None admin] PATH_INFO: `/v3/projects/51900785ee9d499d9709cae42cfc5db2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.647382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f712297-cf03-4445-9035-323f577f7c8b None admin] RBAC: Authorizing `identity:get_project(project_id=51900785ee9d499d9709cae42cfc5db2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.648824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f712297-cf03-4445-9035-323f577f7c8b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.655066 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 226/448] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/projects/51900785ee9d499d9709cae42cfc5db2 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:26.656649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712297-cf03-4445-9035-323f577f7c8b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.697854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:26.709512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:26.745229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f344c-1435-43fc-b71e-4d865c38c1b3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.784389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.785116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.785396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.785664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.786369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:26.786668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.787337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712297-cf03-4445-9035-323f577f7c8b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.788060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.799417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 223/449] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:26.804802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.834392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777ae77-cdaa-42fd-8cf1-5cd0e00b19ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.835027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ae77-cdaa-42fd-8cf1-5cd0e00b19ee None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.835302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ae77-cdaa-42fd-8cf1-5cd0e00b19ee None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.835569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ae77-cdaa-42fd-8cf1-5cd0e00b19ee None admin] PATH_INFO: `/v3/groups/bbe0cdf741784d449cff6a36f68ab17b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.836680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777ae77-cdaa-42fd-8cf1-5cd0e00b19ee None admin] RBAC: Authorizing `identity:get_group(group_id=bbe0cdf741784d449cff6a36f68ab17b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.839820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777ae77-cdaa-42fd-8cf1-5cd0e00b19ee None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.844726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 227/450] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/groups/bbe0cdf741784d449cff6a36f68ab17b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:26.846025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777ae77-cdaa-42fd-8cf1-5cd0e00b19ee None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:26.924062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570d42f-d96a-4826-a0b0-66a10a540306 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.952875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:26.955795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777ae77-cdaa-42fd-8cf1-5cd0e00b19ee None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:26.957842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4265-1da2-44d9-84d4-5cb829fe6dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.958068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:26.958480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4265-1da2-44d9-84d4-5cb829fe6dec None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.958759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4265-1da2-44d9-84d4-5cb829fe6dec None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.959029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe4265-1da2-44d9-84d4-5cb829fe6dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.989545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:26.990170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:26.990445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:26.990716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:26.991498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] RBAC: Adding query filter params (group.id=bbe0cdf741784d449cff6a36f68ab17b, role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=51900785ee9d499d9709cae42cfc5db2) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:26.991803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:26.993211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:26.998762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 228/451] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/role_assignments?group.id=bbe0cdf741784d449cff6a36f68ab17b&scope.project.id=51900785ee9d499d9709cae42cfc5db2&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:27.029193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe4265-1da2-44d9-84d4-5cb829fe6dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:27.030747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe4265-1da2-44d9-84d4-5cb829fe6dec None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:27.147964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 224/452] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 22 14:20:27.153797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:27.264721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff414b-8c54-4f14-81c3-6e65640232b2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:27.299744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716829c7-bc8d-43ce-8f2c-a49b5a276530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:27.300367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716829c7-bc8d-43ce-8f2c-a49b5a276530 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:27.300652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716829c7-bc8d-43ce-8f2c-a49b5a276530 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:27.300917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716829c7-bc8d-43ce-8f2c-a49b5a276530 None admin] PATH_INFO: `/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:27.302072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716829c7-bc8d-43ce-8f2c-a49b5a276530 None admin] RBAC: Authorizing `identity:get_project(project_id=f3670bb30aaf4bc3a00e3f65e0110ae7)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:27.303486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716829c7-bc8d-43ce-8f2c-a49b5a276530 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:27.305099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 229/453] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:20:27 2022] GET /identity/v3/projects/f3670bb30aaf4bc3a00e3f65e0110ae7 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:27.310747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4265-1da2-44d9-84d4-5cb829fe6dec None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:27.344033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:27.413211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe4265-1da2-44d9-84d4-5cb829fe6dec None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:27.446071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0237538-db80-4fa6-b95c-b17320e29c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:27.446692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237538-db80-4fa6-b95c-b17320e29c00 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:27.446968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237538-db80-4fa6-b95c-b17320e29c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:27.447239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0237538-db80-4fa6-b95c-b17320e29c00 None admin] PATH_INFO: `/v3/groups/71a4b09900924750bc0d880d2ff32544` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:27.448332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0237538-db80-4fa6-b95c-b17320e29c00 None admin] RBAC: Authorizing `identity:get_group(group_id=71a4b09900924750bc0d880d2ff32544)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:27.449756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0237538-db80-4fa6-b95c-b17320e29c00 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:27.451328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 225/454] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 22 14:20:27 2022] GET /identity/v3/groups/71a4b09900924750bc0d880d2ff32544 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:27.457466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716829c7-bc8d-43ce-8f2c-a49b5a276530 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:27.491729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:27.553341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716829c7-bc8d-43ce-8f2c-a49b5a276530 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:27.585537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa134b9-0ebc-45ff-b4fd-7fcdff03b13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:27.586148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa134b9-0ebc-45ff-b4fd-7fcdff03b13c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:27.586426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa134b9-0ebc-45ff-b4fd-7fcdff03b13c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:27.586694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa134b9-0ebc-45ff-b4fd-7fcdff03b13c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:27.587412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa134b9-0ebc-45ff-b4fd-7fcdff03b13c None admin] RBAC: Adding query filter params (group.id=71a4b09900924750bc0d880d2ff32544, role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=f3670bb30aaf4bc3a00e3f65e0110ae7) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:27.587718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa134b9-0ebc-45ff-b4fd-7fcdff03b13c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:27.589123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa134b9-0ebc-45ff-b4fd-7fcdff03b13c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:27.594639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 230/455] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 22 14:20:27 2022] GET /identity/v3/role_assignments?group.id=71a4b09900924750bc0d880d2ff32544&scope.project.id=f3670bb30aaf4bc3a00e3f65e0110ae7&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:30.140678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c877-aec3-40e9-a17c-c5ecf59cb77c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:30.141665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c877-aec3-40e9-a17c-c5ecf59cb77c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:30.142162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c877-aec3-40e9-a17c-c5ecf59cb77c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:30.143919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 226/456] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:30.149770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26efdd-842a-45e8-acdf-272bf75fb4c3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:30.150670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26efdd-842a-45e8-acdf-272bf75fb4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:30.151146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26efdd-842a-45e8-acdf-272bf75fb4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:30.174649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ec26efdd-842a-45e8-acdf-272bf75fb4c3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:30.176191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ec26efdd-842a-45e8-acdf-272bf75fb4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:30.279630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 231/457] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:30.634412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5c877-aec3-40e9-a17c-c5ecf59cb77c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:30.706675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceed04-52d6-4a1a-a278-23a5b8422fea None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:30.706956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceed04-52d6-4a1a-a278-23a5b8422fea None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:30.707405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceed04-52d6-4a1a-a278-23a5b8422fea None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:30.709177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 232/458] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:30.715312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f6b53-65e3-4d56-b9e0-c8d5ad3783b0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:30.715826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f6b53-65e3-4d56-b9e0-c8d5ad3783b0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:30.716243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f6b53-65e3-4d56-b9e0-c8d5ad3783b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:30.749281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-102f6b53-65e3-4d56-b9e0-c8d5ad3783b0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:30.752745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-102f6b53-65e3-4d56-b9e0-c8d5ad3783b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:30.790295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:30.795824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5c877-aec3-40e9-a17c-c5ecf59cb77c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:30.799191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:30.861319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:30.861963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:30.862279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:30.862536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:30.874162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:30.875924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:30.876037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 233/459] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:30.877402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c04a2-94e5-4a0c-8725-963eb09c0c20 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:30.877688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c04a2-94e5-4a0c-8725-963eb09c0c20 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:30.877962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c04a2-94e5-4a0c-8725-963eb09c0c20 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:30.879639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 234/460] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:30.884766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959729d-3b35-4268-898b-2413279c76de None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:30.887093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959729d-3b35-4268-898b-2413279c76de None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:30.887614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959729d-3b35-4268-898b-2413279c76de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:30.897569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:30.898533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:30.899403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:30.899403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:30.899403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:30.904849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 227/461] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:30.911933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:30.932481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0959729d-3b35-4268-898b-2413279c76de None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:30.934211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0959729d-3b35-4268-898b-2413279c76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:31.058698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 235/462] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:31.060395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470e5b3-c296-49fd-9be3-ba45b9f911de None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.060903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470e5b3-c296-49fd-9be3-ba45b9f911de None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.061370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470e5b3-c296-49fd-9be3-ba45b9f911de None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.063391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 236/463] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:31.076691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60d13-51dd-4f4f-b536-103159c728f9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.077234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60d13-51dd-4f4f-b536-103159c728f9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.077704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60d13-51dd-4f4f-b536-103159c728f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.097966 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47234f04-a589-44f4-8292-c3ab6dc4e9d0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:31.114974 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a1a60d13-51dd-4f4f-b536-103159c728f9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:31.116778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a1a60d13-51dd-4f4f-b536-103159c728f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:31.159302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:31.160607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.161085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.161748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.163219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:31.163919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:31.166322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:31.196241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 228/464] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:31.197110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:31.217084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:31.225274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 237/465] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:31.231694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a60d13-51dd-4f4f-b536-103159c728f9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:31.282003 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:31.351377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448236cf-b289-483d-8496-a7ffaef8a706 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:31.381108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a60d13-51dd-4f4f-b536-103159c728f9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:31.410255 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:31.410819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.411094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.411536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.418209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20589fd-7b70-4c61-9db1-0556ac3033d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:31.419060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20589fd-7b70-4c61-9db1-0556ac3033d7 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.419538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20589fd-7b70-4c61-9db1-0556ac3033d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.420007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20589fd-7b70-4c61-9db1-0556ac3033d7 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.420859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20589fd-7b70-4c61-9db1-0556ac3033d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:31.422635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20589fd-7b70-4c61-9db1-0556ac3033d7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:31.423606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:31.425155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:31.442679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:31.450845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:31.451923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:31.451923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:31.451923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:31.451923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 229/466] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:31.451923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:31.500815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 238/467] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:20:31 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:31.507274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20589fd-7b70-4c61-9db1-0556ac3033d7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:31.516464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:31.566017 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56cff-a44f-4605-89f4-062c2ea21e10 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:31.615690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:31.616487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.616764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.617034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.633515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:31.635070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:31.640001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:31.654977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:31.656276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:31.657235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:31.657235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:31.657235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:31.659203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 230/468] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:31.660387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:31.679875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20589fd-7b70-4c61-9db1-0556ac3033d7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:31.721605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:31.722256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.722535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.722803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.723463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:31.723766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:31.725137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:31.743869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 239/469] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:31.744723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:31.779957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e49ebf-1de1-46df-9e91-45473deedd34 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:31.796886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:31.816333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afb361-6ac7-4258-a60e-f76ceb70b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:31.816968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afb361-6ac7-4258-a60e-f76ceb70b85d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.817243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afb361-6ac7-4258-a60e-f76ceb70b85d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.817507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afb361-6ac7-4258-a60e-f76ceb70b85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.829447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afb361-6ac7-4258-a60e-f76ceb70b85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:31.830909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afb361-6ac7-4258-a60e-f76ceb70b85d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-f3afb361-6ac7-4258-a60e-f76ceb70b85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:31.845414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:31.846390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 231/470] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71c16-9e73-484d-a47f-cdf3b5ec7062 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71c16-9e73-484d-a47f-cdf3b5ec7062 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71c16-9e73-484d-a47f-cdf3b5ec7062 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 232/471] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:31.852642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71c16-9e73-484d-a47f-cdf3b5ec7062 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:31.853130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fd7d3-1f77-4f15-81a8-3cddd7c407aa None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:31.898147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:31.898760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.899350 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.899676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.900590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:31.900943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:31.902469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:31.905084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:31.923281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 240/472] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:31.923281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:31.964207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71c16-9e73-484d-a47f-cdf3b5ec7062 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:31.997947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8b89-8c59-41d7-b214-10d504aafa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:31.998576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8b89-8c59-41d7-b214-10d504aafa9c None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:31.998850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8b89-8c59-41d7-b214-10d504aafa9c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:31.999119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8b89-8c59-41d7-b214-10d504aafa9c None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:31.999752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b8b89-8c59-41d7-b214-10d504aafa9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:32.001736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b8b89-8c59-41d7-b214-10d504aafa9c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:32.032779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5991-54c0-4185-b6c9-27288e98810b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:32.067027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8524f9-ac86-4bad-91be-882cbfdd2f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:32.067626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8524f9-ac86-4bad-91be-882cbfdd2f44 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:32.067903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8524f9-ac86-4bad-91be-882cbfdd2f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:32.068171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8524f9-ac86-4bad-91be-882cbfdd2f44 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:32.068804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8524f9-ac86-4bad-91be-882cbfdd2f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:32.069102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8524f9-ac86-4bad-91be-882cbfdd2f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:32.070502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8524f9-ac86-4bad-91be-882cbfdd2f44 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:32.082209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 241/473] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:32.083213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f705b-6b6a-4336-ab04-17b882e99663 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:32.083494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f705b-6b6a-4336-ab04-17b882e99663 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:32.083766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f705b-6b6a-4336-ab04-17b882e99663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:32.101205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-be3f705b-6b6a-4336-ab04-17b882e99663 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:32.102672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-be3f705b-6b6a-4336-ab04-17b882e99663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:32.128770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 233/474] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:20:31 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:32.129917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8b89-8c59-41d7-b214-10d504aafa9c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:32.169383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:32.173964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:32.194995 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 242/475] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:32.195867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f705b-6b6a-4336-ab04-17b882e99663 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:32.269748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8b89-8c59-41d7-b214-10d504aafa9c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:32.323490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940c18a-6f79-4ce8-b257-34c304c4afba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:32.325039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c18a-6f79-4ce8-b257-34c304c4afba None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:32.325502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c18a-6f79-4ce8-b257-34c304c4afba None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:32.325955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c18a-6f79-4ce8-b257-34c304c4afba None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:32.326801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940c18a-6f79-4ce8-b257-34c304c4afba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:32.327015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f705b-6b6a-4336-ab04-17b882e99663 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:32.329303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940c18a-6f79-4ce8-b257-34c304c4afba None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:32.373283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee6247-c39f-4d4b-8a00-76ed1f909d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:32.374004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee6247-c39f-4d4b-8a00-76ed1f909d35 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:32.374298 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee6247-c39f-4d4b-8a00-76ed1f909d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:32.374568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee6247-c39f-4d4b-8a00-76ed1f909d35 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:32.375458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee6247-c39f-4d4b-8a00-76ed1f909d35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:32.377072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee6247-c39f-4d4b-8a00-76ed1f909d35 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:32.449456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 234/476] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:20:32 2022] POST /identity/v3/users => generated 248 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:32.478383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 243/477] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:20:32 2022] POST /identity/v3/users => generated 249 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:32.571402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940c18a-6f79-4ce8-b257-34c304c4afba None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:32.679570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:32.700681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940c18a-6f79-4ce8-b257-34c304c4afba None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:32.743635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:32.744403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:32.744681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:32.744992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:32.745711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:32.747240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:32.786086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.sql.core [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 14:20:32.786086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 14:20:32.786086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [parameters: {'id': '9fbf6b7f42244f6bad2f99ee4d4daf24', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 14:20:32.786086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Sep 22 14:20:32.803136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return ref.to_dict() Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 14:20:32.804096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application yield resource Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application next(self.gen) Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise self.value Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application session.commit() Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 14:20:32.805037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.session.flush() Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application compat.raise_( Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 14:20:32.805903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 14:20:32.806895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application conn.query(q) Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application result.read() Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 14:20:32.807827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [parameters: {'id': '9fbf6b7f42244f6bad2f99ee4d4daf24', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:32.808611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 22 14:20:32.810927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:32.813533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 235/478] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 22 14:20:32 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:32.813682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee6247-c39f-4d4b-8a00-76ed1f909d35 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:32.861143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:32.927220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee6247-c39f-4d4b-8a00-76ed1f909d35 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:32.962636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aeab15-8566-4b53-97c0-efa0e4351329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:32.963184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeab15-8566-4b53-97c0-efa0e4351329 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:32.963464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeab15-8566-4b53-97c0-efa0e4351329 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:32.963736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aeab15-8566-4b53-97c0-efa0e4351329 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:32.975155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aeab15-8566-4b53-97c0-efa0e4351329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e2aeab15-8566-4b53-97c0-efa0e4351329 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:32.980729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:32.982798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:32.984700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 244/479] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:20:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:32.995069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:33.131980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8e009-0fa7-4681-ae78-6fe25eb73ad6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:33.168278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d4e7a-41d3-4961-9c6e-c0e4b60af443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:33.168894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4e7a-41d3-4961-9c6e-c0e4b60af443 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:33.169177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4e7a-41d3-4961-9c6e-c0e4b60af443 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:33.169447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4e7a-41d3-4961-9c6e-c0e4b60af443 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:33.170147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d4e7a-41d3-4961-9c6e-c0e4b60af443 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:33.170451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d4e7a-41d3-4961-9c6e-c0e4b60af443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:33.171918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d4e7a-41d3-4961-9c6e-c0e4b60af443 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:33.186152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 236/480] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:33.955860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527215e4-1c95-475c-9b31-68f33701ba5a None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:33.956381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527215e4-1c95-475c-9b31-68f33701ba5a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:33.956381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527215e4-1c95-475c-9b31-68f33701ba5a None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:33.957996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 245/481] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:33.963176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8c3b-1741-4b85-b504-a5a7b2ab073b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:33.963465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8c3b-1741-4b85-b504-a5a7b2ab073b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:33.963742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8c3b-1741-4b85-b504-a5a7b2ab073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:33.980281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:33.986629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8e8c8c3b-1741-4b85-b504-a5a7b2ab073b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:33.987828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8e8c8c3b-1741-4b85-b504-a5a7b2ab073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:34.075426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 237/482] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:34.368345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527215e4-1c95-475c-9b31-68f33701ba5a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:34.474607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527215e4-1c95-475c-9b31-68f33701ba5a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:34.476193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:34.511087 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c594a16-d086-4e61-a07a-bdabf4df72fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:34.511628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594a16-d086-4e61-a07a-bdabf4df72fa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:34.511904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594a16-d086-4e61-a07a-bdabf4df72fa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:34.512173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594a16-d086-4e61-a07a-bdabf4df72fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:34.522656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c594a16-d086-4e61-a07a-bdabf4df72fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0c594a16-d086-4e61-a07a-bdabf4df72fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:34.527446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:34.528358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:34.529159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 246/483] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:34.535326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8c3b-1741-4b85-b504-a5a7b2ab073b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:34.649283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8c3b-1741-4b85-b504-a5a7b2ab073b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:34.695242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:34.695861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:34.696137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:34.696407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:34.697072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:34.697372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:34.698764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:34.701539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:34.713241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 238/484] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:34.719271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c594a16-d086-4e61-a07a-bdabf4df72fa None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:34.838470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c594a16-d086-4e61-a07a-bdabf4df72fa None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:34.873596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc6dfc-92b5-41cc-92ed-8fb75d3a3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:34.874258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc6dfc-92b5-41cc-92ed-8fb75d3a3a2d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:34.874538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc6dfc-92b5-41cc-92ed-8fb75d3a3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:34.875355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc6dfc-92b5-41cc-92ed-8fb75d3a3a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:34.886479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc6dfc-92b5-41cc-92ed-8fb75d3a3a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:34.887965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc6dfc-92b5-41cc-92ed-8fb75d3a3a2d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-21dc6dfc-92b5-41cc-92ed-8fb75d3a3a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:34.904229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:34.905178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:34.906119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:34.906119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:34.906119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:34.906119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 247/485] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:34.911308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:34.924414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9cdbd-6e5d-4832-83a2-75abae62ef14 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:34.924693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9cdbd-6e5d-4832-83a2-75abae62ef14 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:34.924959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9cdbd-6e5d-4832-83a2-75abae62ef14 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:34.926646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 248/486] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:34.931830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eacff1-140a-4df8-a8d4-6ba2d21f0ea5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:34.932111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eacff1-140a-4df8-a8d4-6ba2d21f0ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:34.932383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eacff1-140a-4df8-a8d4-6ba2d21f0ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:34.973568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c4eacff1-140a-4df8-a8d4-6ba2d21f0ea5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:34.974806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c4eacff1-140a-4df8-a8d4-6ba2d21f0ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:34.999408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:35.086134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 249/487] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:35.117348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362f540-686f-4429-8071-4a7facc7da72 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:35.173987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10047c-1695-4dfa-8fbb-0ecbae9e0cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:35.174603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10047c-1695-4dfa-8fbb-0ecbae9e0cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.174879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10047c-1695-4dfa-8fbb-0ecbae9e0cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.175147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10047c-1695-4dfa-8fbb-0ecbae9e0cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.175788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10047c-1695-4dfa-8fbb-0ecbae9e0cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:35.176089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10047c-1695-4dfa-8fbb-0ecbae9e0cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:35.177437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10047c-1695-4dfa-8fbb-0ecbae9e0cb4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:35.197098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 239/488] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:35.203418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eacff1-140a-4df8-a8d4-6ba2d21f0ea5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:35.333486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eacff1-140a-4df8-a8d4-6ba2d21f0ea5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:35.368269 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd4f1-0b9e-4131-8c07-e2e47cf241f5 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.368612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd4f1-0b9e-4131-8c07-e2e47cf241f5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.368725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd4f1-0b9e-4131-8c07-e2e47cf241f5 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.370191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:35.370319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 240/489] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:35.370886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.371171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.371443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.377026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533a143-8f5e-445b-af0d-4ef79090aa54 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.377306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533a143-8f5e-445b-af0d-4ef79090aa54 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.377579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533a143-8f5e-445b-af0d-4ef79090aa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.379871 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:35.381317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:35.395878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:35.396855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:20:35.397788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:35.398846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 250/490] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:20:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:35.408672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:35.418755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4533a143-8f5e-445b-af0d-4ef79090aa54 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:35.419107 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:35.424921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4533a143-8f5e-445b-af0d-4ef79090aa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:35.501444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:35.520465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 241/491] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:35.521645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533a143-8f5e-445b-af0d-4ef79090aa54 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:35.556669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ca346-ca7f-4474-bee5-7a698f352760 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:35.605455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74f197-e503-4ab6-9f78-ed3018c0392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:35.606381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f197-e503-4ab6-9f78-ed3018c0392e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.607120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f197-e503-4ab6-9f78-ed3018c0392e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.607978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74f197-e503-4ab6-9f78-ed3018c0392e None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.609712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74f197-e503-4ab6-9f78-ed3018c0392e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:35.610220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74f197-e503-4ab6-9f78-ed3018c0392e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:35.612763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74f197-e503-4ab6-9f78-ed3018c0392e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:35.652163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533a143-8f5e-445b-af0d-4ef79090aa54 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:35.665199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 251/492] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:20:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:35.666808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54840a-fdfc-4ad9-b3d3-a577fe1f2a3f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.667299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54840a-fdfc-4ad9-b3d3-a577fe1f2a3f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.667728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54840a-fdfc-4ad9-b3d3-a577fe1f2a3f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.669364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 252/493] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:35.675188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54840a-fdfc-4ad9-b3d3-a577fe1f2a3f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:35.699083 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eadf0-51f2-4920-a4c3-fa155c07fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:35.699830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eadf0-51f2-4920-a4c3-fa155c07fe16 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.700181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eadf0-51f2-4920-a4c3-fa155c07fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.700524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eadf0-51f2-4920-a4c3-fa155c07fe16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.712722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eadf0-51f2-4920-a4c3-fa155c07fe16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d74eadf0-51f2-4920-a4c3-fa155c07fe16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:35.718012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:35.719554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:35.720338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 242/494] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:35.722110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cbf41-875d-4d39-8671-2e2fdb7c53c0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.722498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cbf41-875d-4d39-8671-2e2fdb7c53c0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.722873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cbf41-875d-4d39-8671-2e2fdb7c53c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.743030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c89cbf41-875d-4d39-8671-2e2fdb7c53c0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:35.744361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c89cbf41-875d-4d39-8671-2e2fdb7c53c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:35.750924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:35.794647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54840a-fdfc-4ad9-b3d3-a577fe1f2a3f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:35.795752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:35.821577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 243/495] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:35.823216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cbf41-875d-4d39-8671-2e2fdb7c53c0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:35.833431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273804ae-9ff4-47e2-ad4f-48378faa6793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:35.834260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273804ae-9ff4-47e2-ad4f-48378faa6793 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:35.834783 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273804ae-9ff4-47e2-ad4f-48378faa6793 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:35.835245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273804ae-9ff4-47e2-ad4f-48378faa6793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:35.919174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273804ae-9ff4-47e2-ad4f-48378faa6793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:35.920589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273804ae-9ff4-47e2-ad4f-48378faa6793 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:35.978664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cbf41-875d-4d39-8671-2e2fdb7c53c0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:35.988511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.027133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.028771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.029396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.029996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.031232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:36.032166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.034009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.039323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 253/496] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:36.039323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273804ae-9ff4-47e2-ad4f-48378faa6793 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.054320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 244/497] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:36.055200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.101172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.151371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273804ae-9ff4-47e2-ad4f-48378faa6793 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.168978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a27fb-89f9-4a66-90a3-50114568f635 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.190317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3bfe-b819-40c6-97df-8c84c80009b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.190866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3bfe-b819-40c6-97df-8c84c80009b0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.191144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3bfe-b819-40c6-97df-8c84c80009b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.191413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3bfe-b819-40c6-97df-8c84c80009b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.201440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e3bfe-b819-40c6-97df-8c84c80009b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c37e3bfe-b819-40c6-97df-8c84c80009b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:36.206348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:36.207240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:36.208121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 254/498] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:36.209357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3bfe-b819-40c6-97df-8c84c80009b0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.212454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.213253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.213848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.215148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.232128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.233587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.236894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:36.251946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:36.252918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:36.263097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:36.263097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:36.263097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:36.263097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 245/499] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:36.263097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.317304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3bfe-b819-40c6-97df-8c84c80009b0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.343110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.351050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.351674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.351951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.352476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.352665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e239e-bb15-47a3-a0c7-5ecf236e5836 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.362549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.363984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:36.378909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:36.379809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:36.385429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:36.385429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:36.385429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:36.385429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 255/500] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:36.385429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.387725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6963b2-e6d1-4df4-a89c-ce64d299533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.388361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6963b2-e6d1-4df4-a89c-ce64d299533f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.388642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6963b2-e6d1-4df4-a89c-ce64d299533f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.388915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6963b2-e6d1-4df4-a89c-ce64d299533f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.400404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6963b2-e6d1-4df4-a89c-ce64d299533f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-3a6963b2-e6d1-4df4-a89c-ce64d299533f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:36.407390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:36.408292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:36.409101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 246/501] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:36.409770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613fe9-f977-47bd-96c2-d88ea0863da7 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.410060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613fe9-f977-47bd-96c2-d88ea0863da7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.410326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613fe9-f977-47bd-96c2-d88ea0863da7 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.415516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 247/502] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:36.415516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97613fe9-f977-47bd-96c2-d88ea0863da7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.462305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.486715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1a1a0-7175-4178-baf4-0a61ec0d35be None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.514700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97613fe9-f977-47bd-96c2-d88ea0863da7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.521572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.522195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.522471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.522740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.523393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:36.523692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.525048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.533000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 256/503] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:36.534197 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.548015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.548625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.548908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.549183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.549821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:36.550171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.551531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.563624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 248/504] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:36.564408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.577891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.637474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58182-6662-4826-aa0d-ca7d3eb8b699 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.660468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603401e-8245-4e7c-afc4-a4e28c8517cd None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.672081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b2107-5732-4a49-bc19-e95709277ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.673004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2107-5732-4a49-bc19-e95709277ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.673296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2107-5732-4a49-bc19-e95709277ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.673569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2107-5732-4a49-bc19-e95709277ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.674270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b2107-5732-4a49-bc19-e95709277ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:36.674581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b2107-5732-4a49-bc19-e95709277ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.675944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b2107-5732-4a49-bc19-e95709277ae9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.678176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.687988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 257/505] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:36.688958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c347-2550-47ba-a752-e5405092b4e8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.689244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c347-2550-47ba-a752-e5405092b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.689517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1c347-2550-47ba-a752-e5405092b4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.699150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.699753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.700047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.700316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.700981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:36.701277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.702662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.707351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c8d1c347-2550-47ba-a752-e5405092b4e8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:36.708567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c8d1c347-2550-47ba-a752-e5405092b4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:36.711872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 249/506] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:36.712467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.775693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 258/507] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:36.776665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1c347-2550-47ba-a752-e5405092b4e8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.789593 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.814758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e878451-5d97-48b4-ad28-b880e6dd69ca None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.854943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.855721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.856069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.856432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.868054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.869582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.883341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1c347-2550-47ba-a752-e5405092b4e8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:36.885197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:36.886354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:36.892553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:36.892553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:36.892553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:36.892553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 250/508] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:36.892553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.918388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:36.928110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:36.928814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:36.929161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:36.929502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:36.936546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:36.938873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:36.951354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:36.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 259/509] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:36.954896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:36.997393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bada1-6c08-4a09-9ecc-388ca2cb9e76 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.023971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.033416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.038335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.038335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.038335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.042202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.043632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:37.057186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:37.058126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:37.059034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 251/510] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:37.059604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.069124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b3f8d-1bf2-4b95-9202-e705917b12bb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.103148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.103769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.104054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.104321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.116275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.117716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:37.138125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:37.141282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:37.142653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:37.142653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:37.142653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:37.142653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 260/511] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:37.142653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.164635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14568f-fe30-45a3-800c-e41897902027 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.186239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.199171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.201864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.201864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.201864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.201864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:37.201864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.202676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.214169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 252/512] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:37.214956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.254644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b828c8-8122-4a69-8914-b12a517af9b9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.262357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.287359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.287952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.288225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.288493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.289171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:37.289472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.290915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.308894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 261/513] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:37.309684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.318828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373917ce-6b28-4955-b094-aadfe8e05207 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.353031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.353664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.353944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.354256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.365202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.366715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:37.382169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:37.383079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:37.384226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:37.384226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:37.384226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:37.384226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 253/514] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:37.384226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.408503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.411584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4770b-18f3-4190-8ad2-d6cce63ac739 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.446247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.446845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.447154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.447431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.448434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:37.448977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.450853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.467766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 262/515] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:37.469706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.483518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.487837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c65ad-1c45-40b4-96c8-059eaf6c76da None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.521806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.522590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.523014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.523661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.524354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:37.524663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.526058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.538084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 254/516] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:37.538873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.572976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2302b74-eba2-4aa7-ad9a-6f46ce525742 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.606785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.607421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.607677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.607946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.615017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.616456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:37.628554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:37.629622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 263/517] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:37.630846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.639734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f8e8-f944-4a00-8000-05832cf04c32 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.649177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.673961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.674587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.674862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.675130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.675846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=6bc75cc7beb54ef2abd4876b2b35675e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:37.676145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.677566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.682853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 255/518] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/role_assignments?user.id=6bc75cc7beb54ef2abd4876b2b35675e&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:37.683680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.716340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.743696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5060089-9caf-4d14-bd78-7f719e15179d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.783393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.783907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.784185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.784453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.785106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:37.785406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.786841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.804292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 264/519] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:37.805131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:37.805774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331741b-df8c-40ce-92c8-aad7cb06f66d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.848957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ea1ea-a91f-4c02-ac4d-f78d75bc2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.849579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea1ea-a91f-4c02-ac4d-f78d75bc2fbb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.849908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea1ea-a91f-4c02-ac4d-f78d75bc2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.850564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ea1ea-a91f-4c02-ac4d-f78d75bc2fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.891189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.914991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa894-23a8-4c6d-a672-44fa271bc65f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:37.923703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ea1ea-a91f-4c02-ac4d-f78d75bc2fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.925172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ea1ea-a91f-4c02-ac4d-f78d75bc2fbb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.950948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:37.952496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:37.953112 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:37.953391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:37.953663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:37.961944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:37.967685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:37.974797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:37.975673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 265/520] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:37.976731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:38.039991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 256/521] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:38.039991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ea1ea-a91f-4c02-ac4d-f78d75bc2fbb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:38.086036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af391d3-7a1d-4fb7-8c7a-4733500c978f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:38.119938 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:38.120477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:38.120753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:38.121022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:38.121751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:38.122168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:38.123481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:38.126174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:38.141507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 266/522] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 22 14:20:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:38.142437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:38.149940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ea1ea-a91f-4c02-ac4d-f78d75bc2fbb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:38.179888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:38.191414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2635387-51d8-482d-ab68-010671b69c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:38.192104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635387-51d8-482d-ab68-010671b69c82 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:38.192354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635387-51d8-482d-ab68-010671b69c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:38.192621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2635387-51d8-482d-ab68-010671b69c82 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:38.193321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2635387-51d8-482d-ab68-010671b69c82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:38.194784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2635387-51d8-482d-ab68-010671b69c82 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:38.252110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904426f-381b-47be-be79-7cfce917fdb7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:38.287111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:38.287713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:38.287992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:38.288260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:38.288976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:38.289277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:38.290887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:38.308680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 267/523] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Sep 22 14:20:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:38.309298 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:38.340041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 257/524] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:20:38 2022] POST /identity/v3/users => generated 247 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:38.340990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2635387-51d8-482d-ab68-010671b69c82 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:38.379553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:38.445499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0eb0d-416a-42e0-baaa-4faca8b0d658 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:38.467374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2635387-51d8-482d-ab68-010671b69c82 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:38.485636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:38.486446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:38.486799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:38.487140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:38.499022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:38.500653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:38.516762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeac9a5-cdd8-427e-a7c2-b2a47f89f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:38.517692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac9a5-cdd8-427e-a7c2-b2a47f89f128 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:38.518052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:38.518972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:38.519833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:38.519833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:38.519833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:38.520651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac9a5-cdd8-427e-a7c2-b2a47f89f128 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:38.521107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac9a5-cdd8-427e-a7c2-b2a47f89f128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:38.524182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 268/525] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:38.525190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:38.587509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:38.615938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeac9a5-cdd8-427e-a7c2-b2a47f89f128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:38.617251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeac9a5-cdd8-427e-a7c2-b2a47f89f128 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:38.655600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf432687-ac69-4a9e-af11-5d24ecf1ba4d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:38.667887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:38.701971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50932c-61f3-47cf-8df5-27f66d7e48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:38.702646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50932c-61f3-47cf-8df5-27f66d7e48e0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:38.703682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50932c-61f3-47cf-8df5-27f66d7e48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:38.704010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50932c-61f3-47cf-8df5-27f66d7e48e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:38.752170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 258/526] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:38.754308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeac9a5-cdd8-427e-a7c2-b2a47f89f128 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:38.791770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50932c-61f3-47cf-8df5-27f66d7e48e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:38.793232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50932c-61f3-47cf-8df5-27f66d7e48e0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:38.841155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:38.864961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeac9a5-cdd8-427e-a7c2-b2a47f89f128 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:38.903857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:38.904636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:38.904979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:38.905264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:38.906591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:38.906971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:38.908569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:38.909174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 269/527] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:38.910435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50932c-61f3-47cf-8df5-27f66d7e48e0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:38.914217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:38.926713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 259/528] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:38.927842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.017112 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50932c-61f3-47cf-8df5-27f66d7e48e0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.037077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0510-4a74-44a0-9c67-fa8ab531a63a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.051388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.052027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.052301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.052571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.063795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.065231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.075777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.076655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.077112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.077553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:39.081234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:39.082182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:39.083207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:39.083207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:39.083207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:39.086909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 270/529] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:39.087723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.088655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:39.093944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.095670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:39.111322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:39.112446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:39.113479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:39.113479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:39.113479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:39.119993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 260/530] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:39.121175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.148053 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:39.196495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33978c6-89ae-422a-bf3e-7119308d4e4b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.236103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44e45e-4fd5-46a8-bf90-e3ff96c6c703 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.236294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.236792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.237071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.237344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.250840 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.252787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:39.265832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:39.266745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:39.267595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 271/531] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:39.268565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.286122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.287231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.287726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.288213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.289238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:39.289815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.291518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.304724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 261/532] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:39.305849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.364652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:39.382479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e0dc8-0099-475e-8f3d-86d5d99f6ed1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.400823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:39.420641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2999c-4b2e-4ac2-bf70-cf9ed8b7507f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.421174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.422866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.423149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.423419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.424085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:39.424493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.434006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.440535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 272/533] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:39.441285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.465453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.466817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.467323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.467920 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.469573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:39.470147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.472580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.503540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 262/534] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:39.503540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.554908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6937-5138-4243-9812-0d2d5edc6af9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.596632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.597621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.598136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.598629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.606019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d6914-fd34-4f83-9189-b1d95fe55007 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.607225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.610456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.617849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:39.624024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:39.625758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:39.626779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:39.626779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:39.626779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:39.626779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:39.626779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:39.626779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:39.626779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:39.626779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:39.627752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 273/535] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:39.628929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.651165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.653062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.653543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.654202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.661361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.663216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.668067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:39.677233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:39.680691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:39.681554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 263/536] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:39.682606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.750098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43328763-8d0f-4efe-b9e7-443bae4fd6a7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.796234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.797421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.798364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.798364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.800573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=58f40fbc281849418ef9d4c75562c56a) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:39.800573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.800573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.804517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2ae4f-d24f-4570-8ced-22a86c17c7cf None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:39.815390 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 274/537] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/role_assignments?user.id=58f40fbc281849418ef9d4c75562c56a&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:39.815390 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.878065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e97f4-4be4-440a-942b-a11bf86d39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:39.878616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e97f4-4be4-440a-942b-a11bf86d39c8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.878902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e97f4-4be4-440a-942b-a11bf86d39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.879178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e97f4-4be4-440a-942b-a11bf86d39c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.879898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e97f4-4be4-440a-942b-a11bf86d39c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:39.880208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e97f4-4be4-440a-942b-a11bf86d39c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:39.881697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e97f4-4be4-440a-942b-a11bf86d39c8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:39.895882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 264/538] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:39.896958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11513c-04e9-47b3-9cb6-66c967dd1322 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:39.897244 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11513c-04e9-47b3-9cb6-66c967dd1322 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:39.897619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11513c-04e9-47b3-9cb6-66c967dd1322 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:39.903153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 265/539] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:39.904119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11513c-04e9-47b3-9cb6-66c967dd1322 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:39.945115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:39.969169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:39.972111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5e4fd-8fa6-4382-b26d-5b194b284abe None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:40.008790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdc28f-9dbf-4050-af24-2da04ecf2a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:40.009443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc28f-9dbf-4050-af24-2da04ecf2a2d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:40.009723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc28f-9dbf-4050-af24-2da04ecf2a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:40.010023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdc28f-9dbf-4050-af24-2da04ecf2a2d None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:40.010732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdc28f-9dbf-4050-af24-2da04ecf2a2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:40.011042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdc28f-9dbf-4050-af24-2da04ecf2a2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:40.012468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdc28f-9dbf-4050-af24-2da04ecf2a2d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:40.033940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 275/540] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:40.033940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f3f8-4079-4bc8-ada5-535c98dd45e3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:40.033940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f3f8-4079-4bc8-ada5-535c98dd45e3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:40.033940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2f3f8-4079-4bc8-ada5-535c98dd45e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:40.048607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11513c-04e9-47b3-9cb6-66c967dd1322 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:40.050121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-72c2f3f8-4079-4bc8-ada5-535c98dd45e3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:40.051327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-72c2f3f8-4079-4bc8-ada5-535c98dd45e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:40.094133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:40.095619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:40.096104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:40.097040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:40.098603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=71dca3ee8b78402eb95815eb200d90a6) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:40.099271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:40.101321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:40.110084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 266/541] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:39 2022] GET /identity/v3/role_assignments?user.id=71dca3ee8b78402eb95815eb200d90a6&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:40.111174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:40.134005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 276/542] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:40.244496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:40.256917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b56d57-c305-45ce-bc3c-c072ea699540 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:40.295005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:40.295626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:40.295929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:40.296219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:40.297500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=75252b7cba4943b2874983d1a83a9175) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:40.297810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:40.299313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:40.306001 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 267/543] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:40 2022] GET /identity/v3/role_assignments?user.id=75252b7cba4943b2874983d1a83a9175&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:40.564416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f3f8-4079-4bc8-ada5-535c98dd45e3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:40.675580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:40.688713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2f3f8-4079-4bc8-ada5-535c98dd45e3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:40.733517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b06c66-214d-4f57-847e-05ee2af015f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:40.734716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06c66-214d-4f57-847e-05ee2af015f0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:40.734992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06c66-214d-4f57-847e-05ee2af015f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:40.735317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b06c66-214d-4f57-847e-05ee2af015f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:40.751346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b06c66-214d-4f57-847e-05ee2af015f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-11b06c66-214d-4f57-847e-05ee2af015f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:40.756301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:40.757184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:40.758395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 277/544] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:40.767089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:40.926224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994728d-5da3-43da-aad8-7a392d290c3a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:40.958406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04d45-2ca8-4077-b42c-82053a171451 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:40.958724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04d45-2ca8-4077-b42c-82053a171451 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:40.958962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04d45-2ca8-4077-b42c-82053a171451 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:40.960549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 278/545] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:20:40.962145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:40.962760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:40.963041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:40.963317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:40.963991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:40.964298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:40.965738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:40.966723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c9f4-3eb4-4852-a476-5f531904c6ec None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:40.967003 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c9f4-3eb4-4852-a476-5f531904c6ec None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:40.967279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c9f4-3eb4-4852-a476-5f531904c6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:40.975201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 268/546] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:40.982081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:41.011081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3443c9f4-3eb4-4852-a476-5f531904c6ec None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:41.012317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3443c9f4-3eb4-4852-a476-5f531904c6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:41.014900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:41.113454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085894e-db2a-4ff1-983d-7ea85e62f35f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:41.139036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 279/547] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 22 14:20:41.167725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:41.168371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:41.168650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:41.168917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:41.180320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:41.181718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:41.197734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:41.198754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:41.200144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:41.200144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:41.200144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:41.200144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 269/548] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:41.205048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c9f4-3eb4-4852-a476-5f531904c6ec None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:41.326661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:41.350810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c9f4-3eb4-4852-a476-5f531904c6ec None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:41.397465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:41.398105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:41.398385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:41.398646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:41.399299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:41.399599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:41.400967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:41.419895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 280/549] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:41.425855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:41.522666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:41.562870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:41.620923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae5c2-07c4-451f-91c0-3a127136542c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:41.682329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:41.682986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:41.683490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:41.683954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:41.693026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:41.698000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:41.706615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:41.707740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:20:41.708873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:41.710681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 270/550] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:20:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:41.716243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:41.730320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa3fa-0072-4a38-844c-bdab3eb4e93a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:41.825428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300f488-2cf3-4961-a0a7-f803160d1655 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:41.826698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773faa40-b7fc-4e57-b58a-f49efea25030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:41.827363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773faa40-b7fc-4e57-b58a-f49efea25030 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:41.827734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773faa40-b7fc-4e57-b58a-f49efea25030 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:41.828185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773faa40-b7fc-4e57-b58a-f49efea25030 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:41.856449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:41.862393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:41.865652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773faa40-b7fc-4e57-b58a-f49efea25030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-773faa40-b7fc-4e57-b58a-f49efea25030 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:41.870547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:41.873650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:41.874572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 281/551] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:41.875769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:41.875769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:41.875923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:41.876500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:41.877029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:41.877286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:41.878225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773faa40-b7fc-4e57-b58a-f49efea25030 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:41.881345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:41.948666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 271/552] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:20:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:41.954828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:42.036036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773faa40-b7fc-4e57-b58a-f49efea25030 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:42.114849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:42.115397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.115686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.115960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.116718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:42.117030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:42.118450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:42.133401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 282/553] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:42.134860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a8f7b-c915-43f3-87d2-d5bcbd8b51f4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:42.139026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:42.197421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:42.198475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.199370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.200148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.213651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:42.215483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:42.235572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:42.236662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:42.237550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:42.237550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:42.237550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:42.240058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 272/554] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:42.247470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:42.256492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:42.334650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:42.343198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845f7b2-9915-48a4-9702-3681457d8c82 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:42.415564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:42.416148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.416431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.416706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.448227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:42.451394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:42.485523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072602a9-0b3e-49ba-94d0-bd3bdbb56567 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:42.486894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:42.488538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:42.490310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:42.490310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:42.490310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:42.490732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 283/555] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:42.493764 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:42.551403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2659a-40ce-4836-9d2c-6216fd5fb0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:42.552077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2659a-40ce-4836-9d2c-6216fd5fb0ad None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.552355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2659a-40ce-4836-9d2c-6216fd5fb0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.552628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2659a-40ce-4836-9d2c-6216fd5fb0ad None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.553287 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2659a-40ce-4836-9d2c-6216fd5fb0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:42.553590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2659a-40ce-4836-9d2c-6216fd5fb0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:42.555130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2659a-40ce-4836-9d2c-6216fd5fb0ad None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:42.569688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 273/556] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:42.575284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731072e-98de-4d3f-857d-6cbdb78db080 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.575601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731072e-98de-4d3f-857d-6cbdb78db080 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.575909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731072e-98de-4d3f-857d-6cbdb78db080 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.578124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 274/557] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:42.579735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731072e-98de-4d3f-857d-6cbdb78db080 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:42.623558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa0957-00e6-4278-97be-16e31c9a08dc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:42.639905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:42.671317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfa64f-f7d5-4ee7-a52b-2f71a1749bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:42.671833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa64f-f7d5-4ee7-a52b-2f71a1749bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.672119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa64f-f7d5-4ee7-a52b-2f71a1749bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.672583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa64f-f7d5-4ee7-a52b-2f71a1749bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.673332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfa64f-f7d5-4ee7-a52b-2f71a1749bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:42.673639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfa64f-f7d5-4ee7-a52b-2f71a1749bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:42.676164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfa64f-f7d5-4ee7-a52b-2f71a1749bc7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:42.691947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 284/558] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:42.692909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731072e-98de-4d3f-857d-6cbdb78db080 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:42.693218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934bd2-bc90-48fa-b984-93b3f90528f3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.693505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934bd2-bc90-48fa-b984-93b3f90528f3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.693834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934bd2-bc90-48fa-b984-93b3f90528f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.710331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:42.716616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e5934bd2-bc90-48fa-b984-93b3f90528f3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:42.718148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e5934bd2-bc90-48fa-b984-93b3f90528f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:42.731769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:42.732708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.733152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.738768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.741379 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:42.743013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:42.756543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:42.757529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:42.758436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:42.758436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:42.758436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:42.758436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:42.758436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:42.758436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:42.758436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:42.758436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:42.766175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 275/559] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:42.767538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:42.795016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 285/560] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:42.796017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5934bd2-bc90-48fa-b984-93b3f90528f3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:42.881247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edabc97-77c2-4a02-8c8f-489549472ba3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:42.918034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7655409-14bc-4ddc-9780-8890010cce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:42.919005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7655409-14bc-4ddc-9780-8890010cce4a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.919483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7655409-14bc-4ddc-9780-8890010cce4a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.919919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7655409-14bc-4ddc-9780-8890010cce4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.921163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5934bd2-bc90-48fa-b984-93b3f90528f3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:42.924551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:42.929558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7655409-14bc-4ddc-9780-8890010cce4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:42.931474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7655409-14bc-4ddc-9780-8890010cce4a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-f7655409-14bc-4ddc-9780-8890010cce4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:42.944357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:42.951383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 276/561] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:20:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c6f-7e7d-46f5-bbad-f3c5b958c449 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.952377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c6f-7e7d-46f5-bbad-f3c5b958c449 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.953701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22174c6f-7e7d-46f5-bbad-f3c5b958c449 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.953701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 277/562] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:42.955744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ca93-7601-4343-beb0-20e34c842048 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.956261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ca93-7601-4343-beb0-20e34c842048 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.956732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ca93-7601-4343-beb0-20e34c842048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.960018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:42.960636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:42.960920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:42.961206 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:42.961955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:42.962289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:42.963716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:42.981105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ca14ca93-7601-4343-beb0-20e34c842048 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:42.981105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ca14ca93-7601-4343-beb0-20e34c842048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:42.981401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 286/563] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:42.981401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:42.999927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:43.051669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 278/564] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:43.053140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20a4da-ba3a-478b-a794-883114f781b5 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.053425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20a4da-ba3a-478b-a794-883114f781b5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.053701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20a4da-ba3a-478b-a794-883114f781b5 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.058096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 279/565] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:43.058096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20a4da-ba3a-478b-a794-883114f781b5 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:43.095419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45defb-7e8d-465d-a66e-650ec661cf84 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.130548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7313219-f1fb-4b4c-84f4-3734f5d5e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:43.131147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7313219-f1fb-4b4c-84f4-3734f5d5e846 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.131425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7313219-f1fb-4b4c-84f4-3734f5d5e846 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.131695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7313219-f1fb-4b4c-84f4-3734f5d5e846 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.132417 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7313219-f1fb-4b4c-84f4-3734f5d5e846 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:43.132720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7313219-f1fb-4b4c-84f4-3734f5d5e846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:43.134182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7313219-f1fb-4b4c-84f4-3734f5d5e846 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:43.153171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 287/566] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 22 14:20:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:43.154616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48491-ee9f-43b9-9c02-e3fd9c8214ab None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.155054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48491-ee9f-43b9-9c02-e3fd9c8214ab None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.155543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48491-ee9f-43b9-9c02-e3fd9c8214ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.173852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20a4da-ba3a-478b-a794-883114f781b5 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.174225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-eae48491-ee9f-43b9-9c02-e3fd9c8214ab None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:43.175469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-eae48491-ee9f-43b9-9c02-e3fd9c8214ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:43.192991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:43.210727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373229-63ec-4760-a381-9c332ecc5826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:43.212196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373229-63ec-4760-a381-9c332ecc5826 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.212477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373229-63ec-4760-a381-9c332ecc5826 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.212748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba373229-63ec-4760-a381-9c332ecc5826 None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/6bc75cc7beb54ef2abd4876b2b35675e/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.229862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba373229-63ec-4760-a381-9c332ecc5826 None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=6bc75cc7beb54ef2abd4876b2b35675e, role_id=ec7a3b5dd84b4d68bde1443f1c0b3ca9)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:43.231401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba373229-63ec-4760-a381-9c332ecc5826 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:43.247741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 288/567] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:43.248583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae48491-ee9f-43b9-9c02-e3fd9c8214ab None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:43.314310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 280/568] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:20:43 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/6bc75cc7beb54ef2abd4876b2b35675e/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:43.316120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373229-63ec-4760-a381-9c332ecc5826 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:43.333608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:43.387091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae48491-ee9f-43b9-9c02-e3fd9c8214ab None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.445484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d00b4-5426-4e56-b905-c956c4ffd813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:43.446615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d00b4-5426-4e56-b905-c956c4ffd813 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.447106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d00b4-5426-4e56-b905-c956c4ffd813 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.447578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d00b4-5426-4e56-b905-c956c4ffd813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.461566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d00b4-5426-4e56-b905-c956c4ffd813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-fa2d00b4-5426-4e56-b905-c956c4ffd813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:43.467455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:43.469815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:43.470772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:43.473746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 289/569] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:43.474988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d00b4-5426-4e56-b905-c956c4ffd813 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:43.478533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba373229-63ec-4760-a381-9c332ecc5826 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.494741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:43.520532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc2bf-63fa-466d-ae48-e71d95b8716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:43.521159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc2bf-63fa-466d-ae48-e71d95b8716d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.521437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc2bf-63fa-466d-ae48-e71d95b8716d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.521711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dc2bf-63fa-466d-ae48-e71d95b8716d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.595679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc2bf-63fa-466d-ae48-e71d95b8716d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:43.597359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d00b4-5426-4e56-b905-c956c4ffd813 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.597480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dc2bf-63fa-466d-ae48-e71d95b8716d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:43.599519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:43.633298 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759baaa-bec2-4ba9-9399-51092f094064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:43.633921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759baaa-bec2-4ba9-9399-51092f094064 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.634239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759baaa-bec2-4ba9-9399-51092f094064 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.634509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759baaa-bec2-4ba9-9399-51092f094064 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.645613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759baaa-bec2-4ba9-9399-51092f094064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8759baaa-bec2-4ba9-9399-51092f094064 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:43.650527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:43.651466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:43.652339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 290/570] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:43.653059 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759baaa-bec2-4ba9-9399-51092f094064 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:43.707990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 281/571] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:43.709133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc2bf-63fa-466d-ae48-e71d95b8716d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:43.736481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:43.761254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759baaa-bec2-4ba9-9399-51092f094064 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.799618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:43.800226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.800501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.800771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.801436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:43.801738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:43.803213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:43.810658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dc2bf-63fa-466d-ae48-e71d95b8716d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.812291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:43.817835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 291/572] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:43.817835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:43.856009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645424-5d42-4994-86d6-c543d6f83283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:43.856645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645424-5d42-4994-86d6-c543d6f83283 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.856924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645424-5d42-4994-86d6-c543d6f83283 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.857193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645424-5d42-4994-86d6-c543d6f83283 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.868601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4645424-5d42-4994-86d6-c543d6f83283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-a4645424-5d42-4994-86d6-c543d6f83283 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:43.876230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:43.883150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 282/573] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:43.883991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645424-5d42-4994-86d6-c543d6f83283 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:43.954283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa2f1e-2dc4-419f-b1a0-1ba5e3a02893 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.992508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645424-5d42-4994-86d6-c543d6f83283 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:43.994215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:43.995097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:43.995586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:43.996067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:43.996942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:43.997463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:43.999064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.001888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:44.019676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 292/574] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:44.019676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.034890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.035576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.035849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.036121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.048876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.050535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:44.066538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:44.067627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:44.068554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:44.068554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:44.068554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:44.068554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 283/575] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:44.068554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.085913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:44.137530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0ab26-8138-45ab-8b82-17d652ecbd3f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.177413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8076a-a0b4-4e24-bae5-20a3c74ec2ed None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.177657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.178151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.178430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.178692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.192498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.194018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:44.211270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:44.212310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:44.218279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:44.218279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:44.218279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:44.218279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 293/576] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:44.218279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.222751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.223390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.223668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.223939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.224628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:44.224929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.228315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.236924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 284/577] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:44.242220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.272454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:44.326507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:44.330201 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d0498-7b06-44da-bca8-6c3d44038b42 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.351456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75bb8a-7d1f-411e-8dba-9db047e3b6fc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.367175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.367806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.368083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.368352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.380087 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.381519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.387487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.388109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.388383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.388652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.389287 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:44.389586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.391719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:44.397431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:44.398746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:44.399649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:44.399649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:44.399649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:44.399649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 294/578] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:44.399976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.408112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 285/579] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:44.409228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.515076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:44.519004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c0eda-3534-4e04-8e08-572f1b307fed None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.532226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1c9a-e232-4b0e-b6c2-815114cefba5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.555448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.556060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.556365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.556632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.557263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:44.557566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.558991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.570852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.571501 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.571782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.572056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.576750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 295/580] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:44.576750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.581649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:44.591067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.595257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:44.609339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:44.610454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:44.611352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:44.611352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:44.611352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:44.611524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 286/581] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:44.612410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.701551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412b2c-7c6f-407a-bf2e-92582c26380a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.725055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f494-a8b7-466c-9d71-ca455b4bddbb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.742539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.743150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.743428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.743702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.744370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:44.744671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.746067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.760325 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 296/582] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:44.761480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.769304 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.769879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.770209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.770484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.777645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.779210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.788668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:44.791554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:44.793207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 287/583] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:44.795050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.857490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:44.894160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca9fdc-ca7c-470b-b5bb-4902842acd16 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.910511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15acd80-560e-491c-a1b8-0a350c702702 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:44.969542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.970179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.970461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.970562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:44.970731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.971185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:44.971359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:44.971622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:44.971715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.971898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:44.973020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.979854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:44.981265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:44.989676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 288/584] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:44.989676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:44.992824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:44.993756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 297/585] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:44.995040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.080207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:45.097887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cab24-c390-4411-aeb4-672e02d99996 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.100894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232c0b-53a2-47bc-acd8-fb8fc2c07755 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.107524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:45.132375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.133009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.133351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.133630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.141281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.141602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.142254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.142538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.142846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.142956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.143762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:45.144066 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.145512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:45.155095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:45.156716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:45.157652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 289/586] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:45.158892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.168751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 298/587] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:45.168751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.282322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c4276-05e6-4801-98c4-9b468ffc7f22 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.282647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489901b-b66d-475f-af90-0b6a40f96da6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.317854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.318516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.318795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.318896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.319076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.319443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.319722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.319993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.320719 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:45.321021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.322452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.326965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.329093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.332778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:45.340658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:45.351295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 14:20:45.352563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:45.353117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 299/588] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:45.353192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 290/589] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:45.353269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.353347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.383611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:45.461755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9125e08-d7d8-4eb4-b139-05be97a0c95a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.472034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba23752-6cf9-4272-b376-dfbacbeff627 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.499623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.500382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.500776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.501161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.502008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=3d98f829fb354c98a2e170d7f2a00874) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:45.502432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.503982 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.510156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 291/590] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/role_assignments?user.id=3d98f829fb354c98a2e170d7f2a00874&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:45.511159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.526731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.527660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.528094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.528517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.529427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:45.530045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.532489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.560462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 300/591] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:45.560462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.626823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:45.631666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:45.643591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d77fc-8404-4ce7-9cf7-a6b40eb2e67c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.675928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e772c91-8be6-4424-8350-99314f1dac86 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.683571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.684276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.684590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.684861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.697876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.699369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:45.714096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:45.715192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:45.716266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:45.716266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:45.716266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:45.718888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 292/592] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:45.720532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.724822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3540b-6565-40c7-9552-7acb741caf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.725433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3540b-6565-40c7-9552-7acb741caf67 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.725712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3540b-6565-40c7-9552-7acb741caf67 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.725998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3540b-6565-40c7-9552-7acb741caf67 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.726728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3540b-6565-40c7-9552-7acb741caf67 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:45.727286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3540b-6565-40c7-9552-7acb741caf67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.728684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3540b-6565-40c7-9552-7acb741caf67 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.747514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 301/593] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:45.749223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b8b0-b3c6-48bd-8f84-867b91beae67 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.749514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b8b0-b3c6-48bd-8f84-867b91beae67 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.749865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b8b0-b3c6-48bd-8f84-867b91beae67 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.751245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 302/594] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:45.752082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9b8b0-b3c6-48bd-8f84-867b91beae67 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.830957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883cf3-de7f-4405-904c-b8a0061c2bd8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.868710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9b8b0-b3c6-48bd-8f84-867b91beae67 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:45.872835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.873473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.873752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.874053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.884274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:45.887058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.888562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.892336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:45.904351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:45.905454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:45.907470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:45.907470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:45.907470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:45.907642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab7e65-af20-4985-9245-a79bbaa69838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:45.907731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 293/595] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:45.907800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7e65-af20-4985-9245-a79bbaa69838 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.907800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7e65-af20-4985-9245-a79bbaa69838 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.907800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab7e65-af20-4985-9245-a79bbaa69838 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.907993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:45.908062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7e65-af20-4985-9245-a79bbaa69838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:45.908062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7e65-af20-4985-9245-a79bbaa69838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:45.909178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab7e65-af20-4985-9245-a79bbaa69838 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:45.921997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 303/596] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:45.928120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191c3c-bf3f-4362-b31a-37655f486d5c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:45.928120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191c3c-bf3f-4362-b31a-37655f486d5c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:45.928120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191c3c-bf3f-4362-b31a-37655f486d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:45.942596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-55191c3c-bf3f-4362-b31a-37655f486d5c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:45.943851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55191c3c-bf3f-4362-b31a-37655f486d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:46.017418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 304/597] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:46.018598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55191c3c-bf3f-4362-b31a-37655f486d5c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.024843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282447e-d2f8-4687-a712-e00bb5a1e41c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.061505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.062237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.062635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.062857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.074607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.075846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:46.092857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:46.094762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:46.095666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:46.095666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:46.095666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:46.100136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 294/598] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:46.101047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.155562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:46.158640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55191c3c-bf3f-4362-b31a-37655f486d5c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.162157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:46.206406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.208007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.208865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.209360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.210260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:46.210630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdcfe7-109d-4875-8da5-a068c5af8fc3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.211045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.213785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.231226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 305/599] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:46.232495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.252419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.253063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.253340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.253608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.261061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.262534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:46.275758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:46.276704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 295/600] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:46.277625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.368290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e03a12-15f8-4570-aee8-53fe47fb4acf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.383166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f2f92-cf0c-4f59-a436-8e4cf8f842f7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.393834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:46.409812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.410398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.410693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.410953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.411614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:46.411920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.413336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.423163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.424138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.424413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.424686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.427572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 306/601] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:46.427572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.433350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.434842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:46.446594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:46.447625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 296/602] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:46.448538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.462912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:46.557397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448a815-b3e4-40e3-888f-e931b34b4f1a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.564949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e3381-9984-4e7a-b077-a449575541e5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.595144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb0de6-837b-47b6-832c-cd97c679943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.595898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0de6-837b-47b6-832c-cd97c679943b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.596183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0de6-837b-47b6-832c-cd97c679943b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.596461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0de6-837b-47b6-832c-cd97c679943b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.607674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb0de6-837b-47b6-832c-cd97c679943b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:46.608480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.609406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.609889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.610403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.611354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:46.611879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-55fb0de6-837b-47b6-832c-cd97c679943b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:46.613154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:46.614089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:46.614976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:46.615923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.619254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 297/603] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:46.619896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb0de6-837b-47b6-832c-cd97c679943b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.633394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 307/604] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:46.633394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.654659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:46.727123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:46.732726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb0de6-837b-47b6-832c-cd97c679943b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.743598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193e682-5f71-4e1e-9e08-f4b46eb1916e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.770473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.771147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.771399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.771642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.778523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.780150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.782311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.783212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.783691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.784188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.785085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:46.785597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.787226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:46.791329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:46.792243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:46.793146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 298/605] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:46.794199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.804235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 308/606] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:46.805342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.887182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:46.899424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9459772-bc35-48e9-9c16-382f3732e5ec None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.926146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5bd4d-a8ca-498f-9951-32e27636dd97 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:46.933109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.933779 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.934448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.934938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.935973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:46.941420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.941420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.947675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 299/607] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:46.948531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:46.966597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95b9db-97c6-4683-b8a6-d4a9729b168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:46.967279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95b9db-97c6-4683-b8a6-d4a9729b168d None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:46.967555 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95b9db-97c6-4683-b8a6-d4a9729b168d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:46.967824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95b9db-97c6-4683-b8a6-d4a9729b168d None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/58f40fbc281849418ef9d4c75562c56a/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:46.982940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95b9db-97c6-4683-b8a6-d4a9729b168d None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=58f40fbc281849418ef9d4c75562c56a, role_id=ec7a3b5dd84b4d68bde1443f1c0b3ca9)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:46.985038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95b9db-97c6-4683-b8a6-d4a9729b168d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:46.987362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:47.049803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03614-7fb5-4929-9578-c5ca7480be24 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:47.083719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:47.084324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:47.084601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:47.084870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:47.085556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:47.085858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:47.087461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:47.100006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 300/608] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:47.100834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:47.118344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:47.134009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 309/609] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:20:46 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/58f40fbc281849418ef9d4c75562c56a/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:47.134009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95b9db-97c6-4683-b8a6-d4a9729b168d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:47.255899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95b9db-97c6-4683-b8a6-d4a9729b168d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:47.261081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39ab67-6b7c-421d-bfae-e385febf0ea4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:47.297794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:47.298657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:47.299049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:47.299525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:47.301098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5466f9-f9ae-475c-b089-5309dc08a8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:47.301935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5466f9-f9ae-475c-b089-5309dc08a8bf None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:47.302426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5466f9-f9ae-475c-b089-5309dc08a8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:47.302879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5466f9-f9ae-475c-b089-5309dc08a8bf None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/71dca3ee8b78402eb95815eb200d90a6/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:47.312836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:47.314362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:47.321795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5466f9-f9ae-475c-b089-5309dc08a8bf None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=71dca3ee8b78402eb95815eb200d90a6, role_id=ec7a3b5dd84b4d68bde1443f1c0b3ca9)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:47.323764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5466f9-f9ae-475c-b089-5309dc08a8bf None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:47.333237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:47.334271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:47.335170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:47.335170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:47.335170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:47.335170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 310/610] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:47.335414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:47.386698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:47.425339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 301/611] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:20:47 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/71dca3ee8b78402eb95815eb200d90a6/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:47.432908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5466f9-f9ae-475c-b089-5309dc08a8bf None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:47.475428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde67bb-03ae-4093-84e7-10d4478dcba5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:47.549799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049052f-e855-4982-a7c5-7970c02bd226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:47.550592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049052f-e855-4982-a7c5-7970c02bd226 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:47.558186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049052f-e855-4982-a7c5-7970c02bd226 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:47.558186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049052f-e855-4982-a7c5-7970c02bd226 None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/75252b7cba4943b2874983d1a83a9175/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:47.584760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:47.592764 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049052f-e855-4982-a7c5-7970c02bd226 None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=75252b7cba4943b2874983d1a83a9175, role_id=ec7a3b5dd84b4d68bde1443f1c0b3ca9)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:47.596126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049052f-e855-4982-a7c5-7970c02bd226 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:47.647133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5466f9-f9ae-475c-b089-5309dc08a8bf None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:47.688932 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 311/612] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:20:47 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/75252b7cba4943b2874983d1a83a9175/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:47.709865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6128f73-c5b8-4512-90c2-1c4c90b77231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:47.710814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6128f73-c5b8-4512-90c2-1c4c90b77231 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:47.711243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6128f73-c5b8-4512-90c2-1c4c90b77231 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:47.711708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6128f73-c5b8-4512-90c2-1c4c90b77231 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:47.712533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6128f73-c5b8-4512-90c2-1c4c90b77231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:47.713110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6128f73-c5b8-4512-90c2-1c4c90b77231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:47.714728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6128f73-c5b8-4512-90c2-1c4c90b77231 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:47.731424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 302/613] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:47.737059 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049052f-e855-4982-a7c5-7970c02bd226 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:47.748215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3687dd-9f49-4307-9ba5-9d696061d91f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:47.748748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3687dd-9f49-4307-9ba5-9d696061d91f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:47.749314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3687dd-9f49-4307-9ba5-9d696061d91f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:47.751244 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 303/614] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:47.757184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db668b14-6c06-45c9-bf98-506d1cb6d625 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:47.757435 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db668b14-6c06-45c9-bf98-506d1cb6d625 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:47.757680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db668b14-6c06-45c9-bf98-506d1cb6d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:47.789541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-db668b14-6c06-45c9-bf98-506d1cb6d625 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:47.790813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-db668b14-6c06-45c9-bf98-506d1cb6d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:47.933052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 304/615] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:47.951648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:47.957550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049052f-e855-4982-a7c5-7970c02bd226 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:47.999993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:48.001139 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:48.001620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:48.002127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:48.009902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:48.013294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:48.027105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:48.028149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:20:48.029117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:48.031460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 312/616] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:20:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:48.037277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db668b14-6c06-45c9-bf98-506d1cb6d625 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:48.099057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:48.163854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db668b14-6c06-45c9-bf98-506d1cb6d625 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:48.219362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:48.220246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:48.220679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:48.221099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:48.222022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:48.222479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:48.224110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:48.248176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 305/617] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:20:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:48.254620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:48.282156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:48.414169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e35edb-125a-4e4f-8ea7-2bbfe7b779eb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:48.425428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:48.456607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a01c-4de2-4bdd-80e5-d3f2aec5b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:48.457526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a01c-4de2-4bdd-80e5-d3f2aec5b654 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:48.458886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a01c-4de2-4bdd-80e5-d3f2aec5b654 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:48.460488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a01c-4de2-4bdd-80e5-d3f2aec5b654 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:48.466334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecdb72-78b6-4a3c-b443-e7c71cecf31c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:48.490954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a01c-4de2-4bdd-80e5-d3f2aec5b654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-9d94a01c-4de2-4bdd-80e5-d3f2aec5b654 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:48.495816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:48.497106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:48.498267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 306/618] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:48.503851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a01c-4de2-4bdd-80e5-d3f2aec5b654 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:48.508230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee756d-09f8-485d-b587-926b1035086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:48.509039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee756d-09f8-485d-b587-926b1035086f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:48.509472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee756d-09f8-485d-b587-926b1035086f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:48.509910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee756d-09f8-485d-b587-926b1035086f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:48.536987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:48.584586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee756d-09f8-485d-b587-926b1035086f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:48.586433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee756d-09f8-485d-b587-926b1035086f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:48.736440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 313/619] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:48.741971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee756d-09f8-485d-b587-926b1035086f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:48.759020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a01c-4de2-4bdd-80e5-d3f2aec5b654 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:48.826854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:48.830152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:48.830787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:48.831065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:48.831338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:48.832085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:48.832388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:48.833770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:48.856491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 307/620] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:48.864041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:48.916518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee756d-09f8-485d-b587-926b1035086f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:48.934268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:48.969334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:48.971168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:48.972973 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:48.973424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:48.996666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:48.998759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:49.034221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:49.035467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:49.036588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:49.036588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:49.036588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:49.041071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 314/621] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:49.044881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:49.089424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302ae63-2bac-4d6f-9440-6ab73b6b2dd2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:49.159655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:49.161958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.162408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.162826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.187525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:49.189020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:49.213276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:49.214316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:49.215252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:49.215252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:49.215252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:49.222190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e7a80-4a59-4a7d-96d0-9828a98430c7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:49.224280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 308/622] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:49.228683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:49.233582 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:49.263640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:49.264720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.267560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.268080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.269896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:49.270430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:49.272341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:49.302820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 315/623] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:49.307952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:49.412908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:49.421160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b742d8-2cbd-47fb-8431-39bbedfe2e8b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:49.458020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47617a02-f40e-4c69-8d18-6b22bbcaa58c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:49.495219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:49.495955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.496314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.496660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.498474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:49.499884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.500366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.500868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.501990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:49.502490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:49.504471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:49.515958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:49.517415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:49.518869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 309/624] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:49.529912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:49.539304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:49.540273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:49.541193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:49.541193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:49.541193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:49.541193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:49.541193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:49.541193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:49.541193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:49.541193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:49.544723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 316/625] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:49.555028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:49.610300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:49.705779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a1246-df85-45cf-a1e0-864b5aeb0d1e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:49.731644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9028-5425-4d60-bb7d-db7dec336981 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:49.750039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03975a71-aab4-41e6-89a5-6bf6663b79ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:49.750717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975a71-aab4-41e6-89a5-6bf6663b79ff None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.751022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975a71-aab4-41e6-89a5-6bf6663b79ff None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.751465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975a71-aab4-41e6-89a5-6bf6663b79ff None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.752562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03975a71-aab4-41e6-89a5-6bf6663b79ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:49.752866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03975a71-aab4-41e6-89a5-6bf6663b79ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:49.754323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03975a71-aab4-41e6-89a5-6bf6663b79ff None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:49.770092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 317/626] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:49.771342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd8012-5970-4b21-b02a-9e442b33563e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.771622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd8012-5970-4b21-b02a-9e442b33563e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.771893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd8012-5970-4b21-b02a-9e442b33563e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.772855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c97eac-fe9f-4586-9d6f-7cc783e089e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:49.773445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 318/627] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:49.773576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97eac-fe9f-4586-9d6f-7cc783e089e9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.773757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97eac-fe9f-4586-9d6f-7cc783e089e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.777807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97eac-fe9f-4586-9d6f-7cc783e089e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.778880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd8012-5970-4b21-b02a-9e442b33563e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:49.784897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c97eac-fe9f-4586-9d6f-7cc783e089e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:49.787543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c97eac-fe9f-4586-9d6f-7cc783e089e9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d9c97eac-fe9f-4586-9d6f-7cc783e089e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:49.803169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:49.804313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:20:49.805305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:49.812919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 310/628] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:20:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:49.812919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ced3c-24de-461b-a2db-67a078204dc1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.812919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ced3c-24de-461b-a2db-67a078204dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.812919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ced3c-24de-461b-a2db-67a078204dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.822243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:49.836737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4e0ced3c-24de-461b-a2db-67a078204dc1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:49.837943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4e0ced3c-24de-461b-a2db-67a078204dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:49.896657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:49.914021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 311/629] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:49.914021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ced3c-24de-461b-a2db-67a078204dc1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:49.923647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd8012-5970-4b21-b02a-9e442b33563e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:49.975368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abfd9d-1b8a-4f67-a79a-fcb815c3b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:49.977329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abfd9d-1b8a-4f67-a79a-fcb815c3b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:49.981869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abfd9d-1b8a-4f67-a79a-fcb815c3b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:49.982417 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abfd9d-1b8a-4f67-a79a-fcb815c3b2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:49.983365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abfd9d-1b8a-4f67-a79a-fcb815c3b2d7 None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=6bc75cc7beb54ef2abd4876b2b35675e) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:49.983913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abfd9d-1b8a-4f67-a79a-fcb815c3b2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:49.985697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abfd9d-1b8a-4f67-a79a-fcb815c3b2d7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:49.996205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 319/630] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:49 2022] GET /identity/v3/role_assignments?user.id=6bc75cc7beb54ef2abd4876b2b35675e&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:50.068050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41866af5-2901-411a-afe1-5957cab64fc4 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.068666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41866af5-2901-411a-afe1-5957cab64fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.069155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41866af5-2901-411a-afe1-5957cab64fc4 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.072285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 320/631] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:20:50.076959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df342d-af09-4e43-85d4-0028a98b2142 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.077567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df342d-af09-4e43-85d4-0028a98b2142 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.078085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df342d-af09-4e43-85d4-0028a98b2142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.106837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ced3c-24de-461b-a2db-67a078204dc1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:50.114406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f5df342d-af09-4e43-85d4-0028a98b2142 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:50.116014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f5df342d-af09-4e43-85d4-0028a98b2142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:50.186556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:50.197751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:50.198394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.200642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.200642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.200642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:50.200642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:50.201396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:50.229130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 312/632] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 22 14:20:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:50.231974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:50.240863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 321/633] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:50.256972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df342d-af09-4e43-85d4-0028a98b2142 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:50.372135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f01de6-e9a4-483e-92a5-5080652e0511 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:50.380388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:50.411124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df342d-af09-4e43-85d4-0028a98b2142 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:50.428176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b103953-54d9-47c5-a362-a810fdf70379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:50.428827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103953-54d9-47c5-a362-a810fdf70379 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.429114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103953-54d9-47c5-a362-a810fdf70379 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.429405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b103953-54d9-47c5-a362-a810fdf70379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.442141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b103953-54d9-47c5-a362-a810fdf70379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:50.443618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b103953-54d9-47c5-a362-a810fdf70379 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:50.456257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233efbe-9100-4330-8498-bba757dc44df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:50.456956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233efbe-9100-4330-8498-bba757dc44df None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.457245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233efbe-9100-4330-8498-bba757dc44df None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.457493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233efbe-9100-4330-8498-bba757dc44df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-6b103953-54d9-47c5-a362-a810fdf70379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:50.460661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:50.462586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:50.464365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:50.464365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:50.464365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:50.464365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 313/634] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:50.464365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1799056-ad92-44f5-82f8-8f6760db26af None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.464365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1799056-ad92-44f5-82f8-8f6760db26af None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.464365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1799056-ad92-44f5-82f8-8f6760db26af None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.465147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 314/635] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:50.471426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1799056-ad92-44f5-82f8-8f6760db26af None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:50.483135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233efbe-9100-4330-8498-bba757dc44df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8233efbe-9100-4330-8498-bba757dc44df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:50.493388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:50.495124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:50.496701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:50.502006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 322/636] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:20:50.504403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03d30-4998-4d20-b35a-645b29400b25 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.505181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03d30-4998-4d20-b35a-645b29400b25 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.505880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03d30-4998-4d20-b35a-645b29400b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.522202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:50.538255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-39c03d30-4998-4d20-b35a-645b29400b25 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:50.540173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-39c03d30-4998-4d20-b35a-645b29400b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:50.587432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1799056-ad92-44f5-82f8-8f6760db26af None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:50.631214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 323/637] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:50.632775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c03d30-4998-4d20-b35a-645b29400b25 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:50.645067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:50.645682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.645958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.646268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.646917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:50.647220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:50.648584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:50.661388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 315/638] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:50.662292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:50.729960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:50.768441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c03d30-4998-4d20-b35a-645b29400b25 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:50.786156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c91ff9-c486-4e0a-ab1c-cbb3d5401114 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:50.788131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:50.808692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:50.809749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.810066 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.810339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.811007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:50.811305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:50.813115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:50.824761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 324/639] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:50.825618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:50.826241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55a022-8b4c-4877-b7cc-02bda9042aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:50.827134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55a022-8b4c-4877-b7cc-02bda9042aed None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.828408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55a022-8b4c-4877-b7cc-02bda9042aed None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.828990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55a022-8b4c-4877-b7cc-02bda9042aed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.847205 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55a022-8b4c-4877-b7cc-02bda9042aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ea55a022-8b4c-4877-b7cc-02bda9042aed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:50.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:50.855983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:50.856872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:50.860029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 316/640] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:50.861061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55a022-8b4c-4877-b7cc-02bda9042aed None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:50.953605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e1bf-dbab-4f88-85b6-5a093eb5bba7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:50.991047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:50.991682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:50.991964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:50.992239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:50.994350 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:50.999973 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.001629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.003096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55a022-8b4c-4877-b7cc-02bda9042aed None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:51.014266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:51.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 325/641] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:51.016398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.045178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.045814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.046687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.046967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.058990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.060454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:51.074957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:51.076032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:51.076969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:51.076969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:51.076969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:51.076969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 317/642] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:51.076969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.093996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:51.138655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6afa6-0724-4839-8fc0-11d490b00ba0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.175225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.175837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.176451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.176730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.177553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:51.177862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.179257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.192626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 326/643] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:51.192626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.208122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd3214-dd04-444f-84c4-63a3dde57d24 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.253013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ceff-29b9-4f08-9654-d989d5be6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.253829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ceff-29b9-4f08-9654-d989d5be6ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.254423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ceff-29b9-4f08-9654-d989d5be6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.254704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071ceff-29b9-4f08-9654-d989d5be6ca9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.260402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:51.269157 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071ceff-29b9-4f08-9654-d989d5be6ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-a071ceff-29b9-4f08-9654-d989d5be6ca9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:51.276464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:51.277403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 318/644] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:51.282978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ceff-29b9-4f08-9654-d989d5be6ca9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.314855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3ad80-2cc3-41ca-8c68-d2de614ebd94 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.353742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.354382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.354662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.354932 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.355625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:51.355930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.357351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.368580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:51.375718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 327/645] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:51.375718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.402120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071ceff-29b9-4f08-9654-d989d5be6ca9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.439337 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.440070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.440348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.440627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.441280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:51.441583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.443006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.455932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 319/646] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:51.460977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.487037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee040bd8-8722-4260-951b-5ece4d1f96ec None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.504484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:51.531597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.532985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.533421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.533848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.545835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.550142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:51.565514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:51.566844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:51.567976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:51.567976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:51.567976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:51.567976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 328/647] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:51.567976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.583359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af164138-a16b-47d3-8afe-70495425c8d5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.623035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.623755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.624043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.624350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.625057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:51.625334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.626738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.628373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:51.637526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 320/648] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:51.638634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.696335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200bb95-26b3-4776-a56f-6377716086bf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.740347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdeacb-8c64-4bdf-a372-cbc029eac57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.741397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdeacb-8c64-4bdf-a372-cbc029eac57e None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.741882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdeacb-8c64-4bdf-a372-cbc029eac57e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.742399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdeacb-8c64-4bdf-a372-cbc029eac57e None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/3d98f829fb354c98a2e170d7f2a00874/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.763572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdeacb-8c64-4bdf-a372-cbc029eac57e None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=3d98f829fb354c98a2e170d7f2a00874, role_id=ec7a3b5dd84b4d68bde1443f1c0b3ca9)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.766049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdeacb-8c64-4bdf-a372-cbc029eac57e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.777760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd8ae4-b67e-4282-a109-52d983e64701 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:51.816836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:51.817473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:51.817753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:51.818049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:51.825817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:51.828566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:51.840543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:51.845029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 321/649] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:51.846184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.866387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 329/650] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:20:51 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/3d98f829fb354c98a2e170d7f2a00874/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:20:51.879060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdeacb-8c64-4bdf-a372-cbc029eac57e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:51.906963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:51.927217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:51.982221 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2d526-cf91-472a-a39d-ceee2b87b3ef None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.027789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdeacb-8c64-4bdf-a372-cbc029eac57e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.028564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.029309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.029691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.030104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.031124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:52.031526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.034045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.050755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 322/651] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:52.051839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:52.071883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.072525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.072802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.073093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.086344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.087796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:52.103335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:52.104525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:52.105644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:52.105644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:52.105644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:52.109852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 330/652] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:52.112514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:52.175703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d766ab1-338d-40e2-b471-bcce3a5bafd5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.185397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:52.197117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:52.216242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.216876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.217129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.217382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.218179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:52.218476 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.220271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.240155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d03df1-123f-4130-9937-7f41daacd202 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.244349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 323/653] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 22 14:20:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:52.245394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:52.283935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.284915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.285397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.285886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.294503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.296405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:52.309814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:52.310833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 22 14:20:52.311781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:52.315274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 331/654] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:52.316336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:52.366917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14370a77-f286-481d-9ead-09b223810a49 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.404247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.404884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.405159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.405999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.406690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:52.407042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.408534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.424421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 324/655] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:52.425409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:52.441629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b8403-66a1-445b-a2c4-731477ba099f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.472847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:52.477940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:52.486052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893c142-353e-4a63-b7c4-e1d299f721a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.486751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893c142-353e-4a63-b7c4-e1d299f721a3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.487282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893c142-353e-4a63-b7c4-e1d299f721a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.487565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893c142-353e-4a63-b7c4-e1d299f721a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.560192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37007b-f9eb-4df5-8fd3-98acfbea1c89 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.565266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893c142-353e-4a63-b7c4-e1d299f721a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.566892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893c142-353e-4a63-b7c4-e1d299f721a3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.601213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.602160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.602434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.602714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.603440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:52.603743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.605171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.625898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 325/656] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 22 14:20:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:52.626762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:52.688588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 332/657] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:52.689651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e61ea-72ea-403e-bfa5-32d68c5c707a None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.689934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e61ea-72ea-403e-bfa5-32d68c5c707a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.690249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e61ea-72ea-403e-bfa5-32d68c5c707a None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.691614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 333/658] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:52.692152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e61ea-72ea-403e-bfa5-32d68c5c707a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:52.723410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:52.741853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:52.752851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8a45b-0579-4cee-9882-0592899baf78 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.790851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.791539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.791828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.792158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.801626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.803266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.807055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e61ea-72ea-403e-bfa5-32d68c5c707a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:52.816260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:52.817219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 326/659] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:52.823098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:52.853365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42072f39-f4f4-4c25-b853-91596a310598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.854016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072f39-f4f4-4c25-b853-91596a310598 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.854263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072f39-f4f4-4c25-b853-91596a310598 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.854535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072f39-f4f4-4c25-b853-91596a310598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.933001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42072f39-f4f4-4c25-b853-91596a310598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.934022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c32b00-c423-4082-b83b-5de41f71c8b5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:52.934569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42072f39-f4f4-4c25-b853-91596a310598 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:52.967262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:52.970213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eb73e-4d26-4e18-9bd0-4b6a33b41a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:52.970853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eb73e-4d26-4e18-9bd0-4b6a33b41a9c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:52.971133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eb73e-4d26-4e18-9bd0-4b6a33b41a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:52.971405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eb73e-4d26-4e18-9bd0-4b6a33b41a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:52.982275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eb73e-4d26-4e18-9bd0-4b6a33b41a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:52.984720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60eb73e-4d26-4e18-9bd0-4b6a33b41a9c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-f60eb73e-4d26-4e18-9bd0-4b6a33b41a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:53.001276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:53.002468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:53.003837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:53.003837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:53.003837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:53.007045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 327/660] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:53.008233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4ae8-87d2-4053-bbf6-0ae721fd6a5e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.008525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4ae8-87d2-4053-bbf6-0ae721fd6a5e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.008810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4ae8-87d2-4053-bbf6-0ae721fd6a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.016993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:53.028422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7d3d4ae8-87d2-4053-bbf6-0ae721fd6a5e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:53.039335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7d3d4ae8-87d2-4053-bbf6-0ae721fd6a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:53.049965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 334/661] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:53.055224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42072f39-f4f4-4c25-b853-91596a310598 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.109098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 328/662] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:53.110472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d4ae8-87d2-4053-bbf6-0ae721fd6a5e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.169373 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42072f39-f4f4-4c25-b853-91596a310598 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.200549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:53.206802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.207414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.207696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.207977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.208710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:53.209016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:53.210504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:53.230127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 335/663] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:53.230994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.275434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d4ae8-87d2-4053-bbf6-0ae721fd6a5e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.323753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.324856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.325138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.325450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.326967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:53.327329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:53.329241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:53.331679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:53.348186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 329/664] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:53.349289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.354352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00111-4000-4ad6-ad47-e1b2ac04b649 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.396500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.397168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.397649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.397936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.411147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:53.412867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:53.430969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:53.432034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:53.432957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:53.432957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:53.432957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:53.432957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 336/665] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:53.433962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.455472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e24b03-8416-49bd-ba2f-18b24e6262cd None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.481257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:53.492053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b24d5-fdec-400c-9a79-fd46ea370c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.492671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b24d5-fdec-400c-9a79-fd46ea370c59 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.492951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b24d5-fdec-400c-9a79-fd46ea370c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.493222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b24d5-fdec-400c-9a79-fd46ea370c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.548586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732a00f-bf2f-49c3-bd3e-0ba661152280 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.559625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:53.567204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b24d5-fdec-400c-9a79-fd46ea370c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:53.568665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b24d5-fdec-400c-9a79-fd46ea370c59 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:53.585252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988fe4-36be-43db-9292-57974416534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.585930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988fe4-36be-43db-9292-57974416534f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.586239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988fe4-36be-43db-9292-57974416534f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.586512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988fe4-36be-43db-9292-57974416534f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.594261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea988fe4-36be-43db-9292-57974416534f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:53.596474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea988fe4-36be-43db-9292-57974416534f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ea988fe4-36be-43db-9292-57974416534f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:53.610407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:53.611419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 337/666] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:53.612514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988fe4-36be-43db-9292-57974416534f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.681641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 330/667] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:53.681641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b24d5-fdec-400c-9a79-fd46ea370c59 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.732141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:53.736258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988fe4-36be-43db-9292-57974416534f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.775195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:53.775438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ba37c-d38d-480a-acd4-90211192ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.776281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba37c-d38d-480a-acd4-90211192ace5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.776559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba37c-d38d-480a-acd4-90211192ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.776984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ba37c-d38d-480a-acd4-90211192ace5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.782342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b24d5-fdec-400c-9a79-fd46ea370c59 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.788286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ba37c-d38d-480a-acd4-90211192ace5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2d2ba37c-d38d-480a-acd4-90211192ace5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:53.793617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:53.794909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 338/668] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:53.799034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ba37c-d38d-480a-acd4-90211192ace5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.828176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.828820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.829122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.829364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.830051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:53.830355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:53.831722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:53.843504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 331/669] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:53.844467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.919205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ba37c-d38d-480a-acd4-90211192ace5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.952179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2b829-0a8e-4714-bf84-65144e9427b0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:53.960149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.960957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.961487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.961883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:53.962719 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:53.963174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:53.964670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:53.980821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 339/670] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:53.981831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:53.993122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:53.993858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:53.994226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:53.994558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.005175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:54.006683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.008125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:54.023430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:54.029956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:54.032030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:54.032030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:54.032030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:54.032030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 332/671] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:54.032030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.041465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:54.102610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f5e28-44a0-449d-99ff-768067406200 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.141575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.142471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.142638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b2faf-c3fa-4ebe-9d59-40aa9f37b988 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.142921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.143292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.144037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:54.144407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.145935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.154941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 340/672] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:20:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:54.156280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.184218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.184942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.185217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.185486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.192143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.193571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:54.204672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:54.205745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 333/673] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:54.206994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.246345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:54.264142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887394-c16c-40f6-bd0d-aa7c477abe3c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.276797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:54.299366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc0744-de20-42b9-a25d-c8b97a54f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.299965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0744-de20-42b9-a25d-c8b97a54f88f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.300249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0744-de20-42b9-a25d-c8b97a54f88f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.300529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc0744-de20-42b9-a25d-c8b97a54f88f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.301247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc0744-de20-42b9-a25d-c8b97a54f88f None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=58f40fbc281849418ef9d4c75562c56a) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:54.301554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc0744-de20-42b9-a25d-c8b97a54f88f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.303013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc0744-de20-42b9-a25d-c8b97a54f88f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.309471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 341/674] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/role_assignments?user.id=58f40fbc281849418ef9d4c75562c56a&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:54.310902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a45b8-b92e-4bd8-b06e-ffab74c0098e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.311252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a45b8-b92e-4bd8-b06e-ffab74c0098e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.311576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a45b8-b92e-4bd8-b06e-ffab74c0098e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.313014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 342/675] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:54.313833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a45b8-b92e-4bd8-b06e-ffab74c0098e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.322849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c07b1-019f-453f-80fe-ce9952497725 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.371736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.372460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.372745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.373020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.373897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:54.374367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.376059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.395784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 334/676] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:54.395784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.439464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a45b8-b92e-4bd8-b06e-ffab74c0098e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.477945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c162c7f-0e6d-4105-bdca-46de90eae91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.478534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c162c7f-0e6d-4105-bdca-46de90eae91f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.478805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c162c7f-0e6d-4105-bdca-46de90eae91f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.479071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c162c7f-0e6d-4105-bdca-46de90eae91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.492951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c162c7f-0e6d-4105-bdca-46de90eae91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.496618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c162c7f-0e6d-4105-bdca-46de90eae91f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.508466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9c162c7f-0e6d-4105-bdca-46de90eae91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:54.517580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:54.538444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:54.539813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:54.539813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:54.539813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:54.539813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 343/677] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:54.539813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cea22f-e739-4e33-b122-7a5e500d9722 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.539813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cea22f-e739-4e33-b122-7a5e500d9722 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.539813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cea22f-e739-4e33-b122-7a5e500d9722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.540503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03b61b-93ca-48b0-8d18-16a46f46ce32 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.540624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f7cea22f-e739-4e33-b122-7a5e500d9722 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:54.541394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f7cea22f-e739-4e33-b122-7a5e500d9722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:54.567292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:54.580199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.580912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.585323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.585323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.585323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:54.585323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.585323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.601572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 335/678] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:54.603026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.620549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 344/679] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:54.621479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cea22f-e739-4e33-b122-7a5e500d9722 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.729371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cea22f-e739-4e33-b122-7a5e500d9722 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.731456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9aefd-9735-448a-9fa0-32bfe751dfc3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.757898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:54.767069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.773942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.773942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.773942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.773942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:54.773942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.774310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.774411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.774485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.774485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.774485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.778650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.780168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.785408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 345/680] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:54.786568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:54.798120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:54.799098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:54.800034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:54.800034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:54.800034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:54.800034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:54.800034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:54.800034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:54.800034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:54.800034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:54.804141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 336/681] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:54.805075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.866527 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:54.917268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032a97b-3c92-470a-a1dc-776bee2e14a8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.925426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e200e-4b46-48e7-995f-289199bb769f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:54.955785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.956391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.956670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.956938 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.957662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=71dca3ee8b78402eb95815eb200d90a6) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:54.957962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.959408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.962173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:54.962811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:54.963090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:54.963362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:54.966026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 346/682] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/role_assignments?user.id=71dca3ee8b78402eb95815eb200d90a6&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:54.966687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:54.978153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:54.980787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:54.998772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:55.000565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:20:55.001505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:55.009001 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 337/683] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:55.010345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:55.045600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:55.103830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b432c-4cc6-4a74-9be5-51fe2c5e5b3d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:55.145441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:55.146216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:55.146568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:55.146910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:55.147731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:55.148099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:55.149652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:55.163392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651f9ec-65b7-4046-860d-ee1fd00fe618 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:55.164828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 347/684] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:55.165668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:55.173625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:55.212744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7cb7f-61a5-4224-a782-8a2649ea05d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:55.213485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7cb7f-61a5-4224-a782-8a2649ea05d9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:55.213769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7cb7f-61a5-4224-a782-8a2649ea05d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:55.214817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7cb7f-61a5-4224-a782-8a2649ea05d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:55.236092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7cb7f-61a5-4224-a782-8a2649ea05d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-3ab7cb7f-61a5-4224-a782-8a2649ea05d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:20:55.241805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:55.242852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:55.243693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 338/685] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:20:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:55.244396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7cb7f-61a5-4224-a782-8a2649ea05d9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:55.305678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4f86d-34ce-4f87-a321-f1d7643f4029 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:55.321542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:55.344789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:55.345503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:55.345940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:55.346303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:55.347106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:55.347479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:55.349024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:55.369795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 348/686] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:20:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:55.376176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:55.385840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7cb7f-61a5-4224-a782-8a2649ea05d9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:55.428077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:55.428780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:55.429125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:55.429919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:55.430756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=75252b7cba4943b2874983d1a83a9175) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:55.431405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:55.433164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:55.441725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 339/687] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:55 2022] GET /identity/v3/role_assignments?user.id=75252b7cba4943b2874983d1a83a9175&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:55.443136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:55.482796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:55.545245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7de098-879d-4e1e-a0b3-c03f16ab8810 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:55.602526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c51c5-6673-4a1b-9bd6-65c59e4cf511 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:55.612145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:55.612844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:55.613130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:55.613404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:55.614118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:55.614494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:55.615892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:55.641282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 349/688] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:55.647994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:55.665659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f277e-f97c-4c41-b577-1206f3400c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:55.666312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f277e-f97c-4c41-b577-1206f3400c76 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:55.666629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f277e-f97c-4c41-b577-1206f3400c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:55.666901 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f277e-f97c-4c41-b577-1206f3400c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:55.694698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:55.763879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f277e-f97c-4c41-b577-1206f3400c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:55.768068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f277e-f97c-4c41-b577-1206f3400c76 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:55.784753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4fe6d-f93e-4396-83e4-2f64fc8a6bc2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:55.803420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:55.831256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:55.832295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:55.832779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:55.833257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:55.847599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:55.849222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:55.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:55.867955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:55.868870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:55.868870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:55.868870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:55.868870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 350/689] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:55.874721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:55.891921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 340/690] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:55.899018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f277e-f97c-4c41-b577-1206f3400c76 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:56.006780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:56.018838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f277e-f97c-4c41-b577-1206f3400c76 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:56.040726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cbddb-1bfd-40ba-8f60-1b40fd7bd5e1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:56.050562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:56.068466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:56.069041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.069319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.069595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.084669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:56.086186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:56.090910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:56.091542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.091825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.092102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.092892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:56.093590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:56.094571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:56.112702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 351/691] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:56.114019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:56.122237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:56.123201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:56.124737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:56.124737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:56.124737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:56.124737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 341/692] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:56.129239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:56.235525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc997cf-90bf-494a-ab74-faff154b3d0b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:56.304403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:56.305056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.305318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.305590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.316104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:56.317559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:20:56.331223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:56.332191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:20:56.333137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:56.336887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 352/693] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:20:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:56.338074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:56.342282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:56.355994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8147f7-8fdd-4762-a78b-c8eee3636819 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:56.445088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809912-6fa0-467d-9294-90ed4bcb83f4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:56.450691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:56.451317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.451593 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.451861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.453475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:56.453475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:56.454820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:56.481923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:56.482563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.482851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.483131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.484158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:56.484158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:56.485644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:56.489746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 342/694] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:56.499562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:56.510228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 353/695] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 22 14:20:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:56.511478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:56.578788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:56.586803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:56.648622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a371f4b-1378-4637-adcb-6defd0760dd2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:56.698389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b1bab-1d78-4d9e-a921-4899eb6a786e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:56.711742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cc914-f776-4401-9da0-da99b2db1162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:56.712353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc914-f776-4401-9da0-da99b2db1162 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.712626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc914-f776-4401-9da0-da99b2db1162 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.712892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc914-f776-4401-9da0-da99b2db1162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.769681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:56.770376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.770656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.770932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.787667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:56.789359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:56.805152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cc914-f776-4401-9da0-da99b2db1162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:56.806658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cc914-f776-4401-9da0-da99b2db1162 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:56.813531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:56.814512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:56.815444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:56.815444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:56.815444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:56.815444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:56.815444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:56.815444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:56.815444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:56.815444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:56.822655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 343/696] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:56.823910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:56.922477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:56.933620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e458072-1331-410b-b4b9-d425fea5335b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:56.935163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:56.953790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 354/697] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:20:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 22 14:20:56.955116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9805-7832-49e2-9940-81f6eff871b0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.955408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9805-7832-49e2-9940-81f6eff871b0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.955689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9805-7832-49e2-9940-81f6eff871b0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.957199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 355/698] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:56.961778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9805-7832-49e2-9940-81f6eff871b0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:56.973290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731076c-4377-4f27-b2ab-84c5a4b9fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:56.974192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731076c-4377-4f27-b2ab-84c5a4b9fc24 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.974648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731076c-4377-4f27-b2ab-84c5a4b9fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.979822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731076c-4377-4f27-b2ab-84c5a4b9fc24 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:56.979822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731076c-4377-4f27-b2ab-84c5a4b9fc24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:56.979822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731076c-4377-4f27-b2ab-84c5a4b9fc24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:56.979822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731076c-4377-4f27-b2ab-84c5a4b9fc24 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:56.990771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 344/699] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:56.997279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22958f52-0416-417c-bbd0-f9100e8d5e83 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:56.997995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22958f52-0416-417c-bbd0-f9100e8d5e83 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:56.998422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22958f52-0416-417c-bbd0-f9100e8d5e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.025410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-22958f52-0416-417c-bbd0-f9100e8d5e83 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:57.027695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-22958f52-0416-417c-bbd0-f9100e8d5e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:57.069177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9805-7832-49e2-9940-81f6eff871b0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:57.104655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:57.105286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:57.105562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:57.105834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.116577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:57.118169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:57.120035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 345/700] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:57.120889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22958f52-0416-417c-bbd0-f9100e8d5e83 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:57.148423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:57.149496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:57.150960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:57.150960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:57.150960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:57.156395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 356/701] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:57.158511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:57.191203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:57.219210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:57.228678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22958f52-0416-417c-bbd0-f9100e8d5e83 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:57.297064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:57.298095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:57.298739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:57.299320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.300252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=6bc75cc7beb54ef2abd4876b2b35675e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:57.300761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:57.302633 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:57.309039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 346/702] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:57 2022] GET /identity/v3/role_assignments?user.id=6bc75cc7beb54ef2abd4876b2b35675e&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:57.361328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5ed0-88b8-4470-be36-9e57f761c435 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:57.409063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:57.409779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:57.410133 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:57.410421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.414825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:57.414825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:57.414825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:57.427158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 357/703] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:57.432929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:57.486012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:57.585803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:57.615041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5917349-e1ef-485d-a8d4-9f9cccf464ef None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:57.616651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac3f82-1eb6-4d9d-ab74-b411df815ee2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:57.662119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:57.662765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:57.663046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:57.663318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.664010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:57.665523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:57.677553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:57.678662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:57.680305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 358/704] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Sep 22 14:20:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:57.684545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:57.687312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7c71e-a6f6-48e8-9672-fd4b723b72f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:57.688280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c71e-a6f6-48e8-9672-fd4b723b72f6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:57.688562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c71e-a6f6-48e8-9672-fd4b723b72f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:57.688834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7c71e-a6f6-48e8-9672-fd4b723b72f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.709529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c71e-a6f6-48e8-9672-fd4b723b72f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:57.711031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7c71e-a6f6-48e8-9672-fd4b723b72f6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-8af7c71e-a6f6-48e8-9672-fd4b723b72f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:20:57.725547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:57.728075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 347/705] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc57184-ecac-4124-a674-fc38b4342d11 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:57.730265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc57184-ecac-4124-a674-fc38b4342d11 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:57.736190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc57184-ecac-4124-a674-fc38b4342d11 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.736190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 348/706] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:57.737190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c31046-57f5-445f-aba0-9db2be8e723b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:57.737469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c31046-57f5-445f-aba0-9db2be8e723b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:57.738585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c31046-57f5-445f-aba0-9db2be8e723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.763486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-70c31046-57f5-445f-aba0-9db2be8e723b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:57.766563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-70c31046-57f5-445f-aba0-9db2be8e723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:57.782395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:57.798693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a890-d4d6-4278-be1f-63188f8199fa None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:57.836372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:57.837222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:57.837670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:57.838127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:57.838917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:57.839360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:57.840927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:57.851873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 359/707] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 22 14:20:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:57.853043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:57.866058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 349/708] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:20:57.866316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:57.867438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c31046-57f5-445f-aba0-9db2be8e723b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:58.017348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c31046-57f5-445f-aba0-9db2be8e723b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:58.039845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436ae5e-90ab-4aea-abcf-a89563b6c5e5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:58.058423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:58.059366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:58.059823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:58.060746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:58.062420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:58.063325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:58.065071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:58.072321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 350/709] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 22 14:20:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:58.119392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34eb982-c866-4936-9f9b-c184b9f47040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:58.120090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb982-c866-4936-9f9b-c184b9f47040 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:58.120369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb982-c866-4936-9f9b-c184b9f47040 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:58.120638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb982-c866-4936-9f9b-c184b9f47040 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:58.121333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34eb982-c866-4936-9f9b-c184b9f47040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:58.121633 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34eb982-c866-4936-9f9b-c184b9f47040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:58.123073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34eb982-c866-4936-9f9b-c184b9f47040 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:58.142327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 360/710] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:58.148234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:58.178513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:58.315925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f3a7-a591-4d35-a1bc-0628cf7c72e3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:58.327669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d927-ef0a-4a19-96ff-388cc6699401 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:58.327986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d927-ef0a-4a19-96ff-388cc6699401 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:58.328229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941d927-ef0a-4a19-96ff-388cc6699401 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:58.331143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 361/711] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:20:58.335429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f1e1b-9412-45ab-a5d9-8765d192f731 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:58.335944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f1e1b-9412-45ab-a5d9-8765d192f731 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:58.336492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f1e1b-9412-45ab-a5d9-8765d192f731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:58.352733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:58.353354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:58.353634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:58.353908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:58.354705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=3d98f829fb354c98a2e170d7f2a00874) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:58.355006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:58.356874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:58.365371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c38f1e1b-9412-45ab-a5d9-8765d192f731 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:20:58.366599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c38f1e1b-9412-45ab-a5d9-8765d192f731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:20:58.370047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 351/712] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:20:58 2022] GET /identity/v3/role_assignments?user.id=3d98f829fb354c98a2e170d7f2a00874&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:20:58.371302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:58.473714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:58.492605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 362/713] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:20:58.504401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:58.552958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60bb0-ffed-4aba-bfe9-4fbb73f07191 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:58.595447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:58.596016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:58.596295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:58.596569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:58.607766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:58.609840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:20:58.624902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:58.626343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:20:58.627237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:20:58.627237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:20:58.627237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:20:58.627237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 352/714] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:58.633800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f1e1b-9412-45ab-a5d9-8765d192f731 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:58.741529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f1e1b-9412-45ab-a5d9-8765d192f731 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:58.778576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:58.779569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:58.780111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:58.780643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:58.781553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:58.782080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:58.783650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:58.797231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 363/715] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:58.803133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:58.849015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:58.915864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:58.927174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedc38e-5baf-4a0f-89f5-a7816d74a77e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:58.956580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:58.971889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd3ff-5a3e-48a2-95aa-f401098bf61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:58.972560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd3ff-5a3e-48a2-95aa-f401098bf61f None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:58.972840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd3ff-5a3e-48a2-95aa-f401098bf61f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:58.973115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bd3ff-5a3e-48a2-95aa-f401098bf61f None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:58.973768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bd3ff-5a3e-48a2-95aa-f401098bf61f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:58.975250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bd3ff-5a3e-48a2-95aa-f401098bf61f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:58.979423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf4360-cb6c-4d4b-95f5-4014a99255aa None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:59.026260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:59.027246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:59.027817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:59.028319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] PATH_INFO: `/v3/services/network` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:59.029177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:59.032061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:20:59.042092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:20:59.043137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:20:59.044019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:20:59.047965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 364/716] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:20:58 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:20:59.053520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:59.056900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 353/717] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:20:58 2022] POST /identity/v3/users => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:20:59.184261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666803e-7b1d-44ef-ba17-5fac11d94d2e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:59.204363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:20:59.231808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a317c5-a9d5-48e2-a522-51fb9c2340fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:59.232648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a317c5-a9d5-48e2-a522-51fb9c2340fb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:59.233036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a317c5-a9d5-48e2-a522-51fb9c2340fb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:59.233566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a317c5-a9d5-48e2-a522-51fb9c2340fb None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:59.234586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a317c5-a9d5-48e2-a522-51fb9c2340fb None admin] RBAC: Adding query filter params (name=network) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:59.235009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a317c5-a9d5-48e2-a522-51fb9c2340fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:59.236524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a317c5-a9d5-48e2-a522-51fb9c2340fb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:59.248450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 365/718] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:20:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:20:59.254064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd3ff-5a3e-48a2-95aa-f401098bf61f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:20:59.427081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bd3ff-5a3e-48a2-95aa-f401098bf61f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:20:59.466726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f10c6-5f05-484e-82b1-c66e699fc156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:20:59.467451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f10c6-5f05-484e-82b1-c66e699fc156 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:20:59.468776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f10c6-5f05-484e-82b1-c66e699fc156 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:20:59.469147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f10c6-5f05-484e-82b1-c66e699fc156 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:20:59.469893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f10c6-5f05-484e-82b1-c66e699fc156 None admin] RBAC: Adding query filter params (type=network) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:20:59.470319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f10c6-5f05-484e-82b1-c66e699fc156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:20:59.471806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f10c6-5f05-484e-82b1-c66e699fc156 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:20:59.477723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 354/719] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:20:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:00.001195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73d64-bf11-40ec-b626-51541d52d79e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:00.001593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73d64-bf11-40ec-b626-51541d52d79e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:00.001791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73d64-bf11-40ec-b626-51541d52d79e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:00.003462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 366/720] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:00.009055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d8fb-49e6-4ab7-8d18-b8baafa510f9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:00.009562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d8fb-49e6-4ab7-8d18-b8baafa510f9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:00.009644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d8fb-49e6-4ab7-8d18-b8baafa510f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:00.035522 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c098d8fb-49e6-4ab7-8d18-b8baafa510f9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:00.036747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c098d8fb-49e6-4ab7-8d18-b8baafa510f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:00.084163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:00.122176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 355/721] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:21:00.546229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd73d64-bf11-40ec-b626-51541d52d79e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:00.673514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd73d64-bf11-40ec-b626-51541d52d79e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:00.711717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751c372-2af6-4e78-8812-334ff54787e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:00.712358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c372-2af6-4e78-8812-334ff54787e6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:00.712638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c372-2af6-4e78-8812-334ff54787e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:00.712917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c372-2af6-4e78-8812-334ff54787e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:00.724309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751c372-2af6-4e78-8812-334ff54787e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c751c372-2af6-4e78-8812-334ff54787e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:00.730036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:00.730988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:00.732079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 367/722] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:00.743114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098d8fb-49e6-4ab7-8d18-b8baafa510f9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:00.893388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098d8fb-49e6-4ab7-8d18-b8baafa510f9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:00.939489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40073-8e29-43fc-ab3c-8a14fdfeca19 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:00.939819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40073-8e29-43fc-ab3c-8a14fdfeca19 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:00.939943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:00.940059 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40073-8e29-43fc-ab3c-8a14fdfeca19 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:00.940498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:00.940846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:00.941126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:00.941730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 368/723] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:00.941836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:00.942117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:00.943605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:00.946822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54852f9e-ef41-45e0-bf1e-9b00dd5ba7b4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:00.947100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54852f9e-ef41-45e0-bf1e-9b00dd5ba7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:00.947367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54852f9e-ef41-45e0-bf1e-9b00dd5ba7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:00.954092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 356/724] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:00.959581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:00.987147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-54852f9e-ef41-45e0-bf1e-9b00dd5ba7b4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:00.988462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-54852f9e-ef41-45e0-bf1e-9b00dd5ba7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:01.022667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:01.029712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:01.095529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 369/725] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:21:01.131158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb6ed1-ccc7-42df-b1c0-2eb0850503cf None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:01.180875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:01.181431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:01.181706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:01.181996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:01.198107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:01.199549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:01.218061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:01.219081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:01.220409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:01.220409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:01.220409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:01.220409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 357/726] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:01.226374 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54852f9e-ef41-45e0-bf1e-9b00dd5ba7b4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:01.338662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54852f9e-ef41-45e0-bf1e-9b00dd5ba7b4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:01.377568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2a2b1-ba72-4633-83ed-a7cd63b52876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:01.378216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a2b1-ba72-4633-83ed-a7cd63b52876 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:01.378493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a2b1-ba72-4633-83ed-a7cd63b52876 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:01.378763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a2b1-ba72-4633-83ed-a7cd63b52876 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:01.379414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2a2b1-ba72-4633-83ed-a7cd63b52876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:01.379710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2a2b1-ba72-4633-83ed-a7cd63b52876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:01.381071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2a2b1-ba72-4633-83ed-a7cd63b52876 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:01.398354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 370/727] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:01.399861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:01.533256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:01.542604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2af3c0-caf4-4ded-a51f-a73c538a9fc6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:01.563313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9d1d-292e-48b2-8717-81f44156137d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:01.563827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9d1d-292e-48b2-8717-81f44156137d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:01.563827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f9d1d-292e-48b2-8717-81f44156137d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:01.565240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 371/728] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:01.571887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75ce48-9bb2-4684-92fc-ee3d1117bca2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:01.572164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75ce48-9bb2-4684-92fc-ee3d1117bca2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:01.572437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75ce48-9bb2-4684-92fc-ee3d1117bca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:01.598948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9d75ce48-9bb2-4684-92fc-ee3d1117bca2 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:01.600365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9d75ce48-9bb2-4684-92fc-ee3d1117bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:01.600677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:01.601314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:01.601842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:01.602145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:01.610245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:01.611708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:01.623128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:01.624662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 358/729] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:21:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:01.626230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:01.633534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:01.682380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 372/730] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 22 14:21:01.683243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75ce48-9bb2-4684-92fc-ee3d1117bca2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:01.799943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea463-aed3-4def-bd52-367724a31edf None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:01.868607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75ce48-9bb2-4684-92fc-ee3d1117bca2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:01.870712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1232c-e539-49c5-8501-a621e2a61439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:01.871340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1232c-e539-49c5-8501-a621e2a61439 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:01.871621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1232c-e539-49c5-8501-a621e2a61439 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:01.871895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1232c-e539-49c5-8501-a621e2a61439 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:01.872552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1232c-e539-49c5-8501-a621e2a61439 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:01.874680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1232c-e539-49c5-8501-a621e2a61439 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:01.906743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:01.907354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:01.907634 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:01.907960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:01.908704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:01.909004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:01.910541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:01.934973 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 373/731] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:21:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:01.941884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:01.964125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:02.025921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 359/732] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:21:01 2022] POST /identity/v3/services => generated 251 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:02.027015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1232c-e539-49c5-8501-a621e2a61439 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:02.051605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:02.087050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e020f-4508-4409-b5b2-0a0ed80d01c7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:02.149542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccaa60-7ec5-432d-95a2-17b2710ab6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:02.150220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccaa60-7ec5-432d-95a2-17b2710ab6bf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.150503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccaa60-7ec5-432d-95a2-17b2710ab6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.150776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccaa60-7ec5-432d-95a2-17b2710ab6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.164321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccaa60-7ec5-432d-95a2-17b2710ab6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:02.165819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccaa60-7ec5-432d-95a2-17b2710ab6bf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:02.169022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1232c-e539-49c5-8501-a621e2a61439 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3dccaa60-7ec5-432d-95a2-17b2710ab6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:02.182006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:02.183089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:02.183993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:02.183993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:02.183993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:02.183993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 374/733] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:02.184788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9803e-21c3-4827-b9eb-7b86423e1322 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.184788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9803e-21c3-4827-b9eb-7b86423e1322 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.184930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9803e-21c3-4827-b9eb-7b86423e1322 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.191358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 375/734] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:02.191358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67dcf-f1be-4f37-9a42-13a0d23e9629 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.191358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67dcf-f1be-4f37-9a42-13a0d23e9629 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.191358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67dcf-f1be-4f37-9a42-13a0d23e9629 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.191358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 376/735] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:02.191358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67dcf-f1be-4f37-9a42-13a0d23e9629 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:02.219361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab87846-3aed-40f1-90c5-5812232cc375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:02.220284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87846-3aed-40f1-90c5-5812232cc375 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.220565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87846-3aed-40f1-90c5-5812232cc375 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.220830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab87846-3aed-40f1-90c5-5812232cc375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.236260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab87846-3aed-40f1-90c5-5812232cc375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-4ab87846-3aed-40f1-90c5-5812232cc375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:02.242559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:02.243568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:02.244497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 360/736] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:02.245720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca39f-34b9-46b4-ace9-c8acf313f120 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.245887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca39f-34b9-46b4-ace9-c8acf313f120 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.248036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ca39f-34b9-46b4-ace9-c8acf313f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.266900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a83ca39f-34b9-46b4-ace9-c8acf313f120 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:02.268239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a83ca39f-34b9-46b4-ace9-c8acf313f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:02.282365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:02.309344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67dcf-f1be-4f37-9a42-13a0d23e9629 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:02.335079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:02.340306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 361/737] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:21:02.345417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27638ed-4958-4313-9606-4592bb76c08c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.345417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27638ed-4958-4313-9606-4592bb76c08c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.345417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27638ed-4958-4313-9606-4592bb76c08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.353347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:02.354209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.354637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.355057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.356303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:02.356778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:02.358671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:02.363121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c27638ed-4958-4313-9606-4592bb76c08c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:02.364483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c27638ed-4958-4313-9606-4592bb76c08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:02.372218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 377/738] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:02.373226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:02.458135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 362/739] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 22 14:21:02.459239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27638ed-4958-4313-9606-4592bb76c08c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:02.510939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4c185-5346-491f-8fba-429dca0daef6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:02.554794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:02.566677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:02.566677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.566677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.566677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.567541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:02.567541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:02.568415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:02.587692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 378/740] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:02.594488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:02.642766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27638ed-4958-4313-9606-4592bb76c08c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:02.678387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:02.687406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:02.688064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.688345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.688619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.697440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:02.699666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:02.715784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:02.716879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 363/741] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:02.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:02.725416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41d2b5-026d-40a7-b856-bade3dee0852 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:02.764886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:02.765994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.766510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.766976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.779585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:02.781691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:02.796328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:02.797637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:02.798589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:02.798589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:02.798589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:02.798589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 379/742] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:02.798589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:02.837794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966912c2-f1ce-4657-a8e3-5df232f4265f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:02.843863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:02.874704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1436227-6693-42b4-b7e2-7d7e3c928815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:02.875325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436227-6693-42b4-b7e2-7d7e3c928815 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.875606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436227-6693-42b4-b7e2-7d7e3c928815 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.875876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1436227-6693-42b4-b7e2-7d7e3c928815 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.876528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1436227-6693-42b4-b7e2-7d7e3c928815 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:02.877997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1436227-6693-42b4-b7e2-7d7e3c928815 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:02.904771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44688aa5-5a73-49d1-bf05-8321a24681b9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:02.940864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:02.941468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:02.941746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:02.942045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:02.942735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:02.943039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:02.944609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:02.957354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 380/743] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:02.958167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:02.986224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 364/744] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:21:02 2022] POST /identity/v3/services => generated 240 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:02.987167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1436227-6693-42b4-b7e2-7d7e3c928815 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:03.075094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:03.079118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f828d7-eeea-416a-93c6-7255495a2ff7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:03.086418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:03.125546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda92c9f-c3a4-4fbb-bd6d-12a31fa59755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:03.126184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda92c9f-c3a4-4fbb-bd6d-12a31fa59755 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:03.126465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda92c9f-c3a4-4fbb-bd6d-12a31fa59755 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:03.126734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda92c9f-c3a4-4fbb-bd6d-12a31fa59755 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:03.139144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda92c9f-c3a4-4fbb-bd6d-12a31fa59755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-bda92c9f-c3a4-4fbb-bd6d-12a31fa59755 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:03.144104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:03.145079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:21:03.145955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:03.150500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 381/745] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:21:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:03.151396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda92c9f-c3a4-4fbb-bd6d-12a31fa59755 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:03.153463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1436227-6693-42b4-b7e2-7d7e3c928815 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:03.207270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:03.207944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:03.208173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:03.208443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:03.209112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:03.209394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:03.211292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:03.223545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 365/746] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:03.223923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:03.275073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda92c9f-c3a4-4fbb-bd6d-12a31fa59755 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:03.323019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ac7e2-a179-42ea-a1cd-2878098911eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:03.324227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ac7e2-a179-42ea-a1cd-2878098911eb None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:03.324723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ac7e2-a179-42ea-a1cd-2878098911eb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:03.325502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ac7e2-a179-42ea-a1cd-2878098911eb None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/6bc75cc7beb54ef2abd4876b2b35675e/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:03.328877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ac7e2-a179-42ea-a1cd-2878098911eb None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=6bc75cc7beb54ef2abd4876b2b35675e, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:03.332521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ac7e2-a179-42ea-a1cd-2878098911eb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:03.343967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c051c-c5f9-4cdd-933f-6d588f33a3b0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:03.356464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:03.381919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:03.382238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:03.382561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:03.382840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:03.383563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:03.383873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:03.385240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:03.398184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 366/747] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:21:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:03.398184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:03.412111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 382/748] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:21:03 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/6bc75cc7beb54ef2abd4876b2b35675e/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:21:03.414130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ac7e2-a179-42ea-a1cd-2878098911eb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:03.459491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:03.584578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138dce1-c0bc-4920-8c47-735e4d83620d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:03.616471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ac7e2-a179-42ea-a1cd-2878098911eb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:03.624698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76172494-ad01-4181-9357-1848beb5252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:03.625654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172494-ad01-4181-9357-1848beb5252f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:03.626171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172494-ad01-4181-9357-1848beb5252f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:03.626643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76172494-ad01-4181-9357-1848beb5252f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:03.635067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76172494-ad01-4181-9357-1848beb5252f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:03.636750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76172494-ad01-4181-9357-1848beb5252f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-76172494-ad01-4181-9357-1848beb5252f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:03.653620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:03.655005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:21:03.655960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:03.656508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:03.656508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:03.656662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:03.657365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:03.659059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 367/749] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:03.667218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76172494-ad01-4181-9357-1848beb5252f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:03.671011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:03.672503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:03.688902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:03.690134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:03.691462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:03.691462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:03.691462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:03.696904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 383/750] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:03.698296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:03.752545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:03.771368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:03.807303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de1c2-8d68-47b1-a2f7-ba94ba58ad77 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:03.844441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:03.845220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:03.845606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:03.845993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:03.846767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:03.847194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:03.848669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:03.866942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 384/751] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:03.868456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:03.922410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76172494-ad01-4181-9357-1848beb5252f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:03.978854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c0e12-8aa4-429f-bf0e-8e2bd3437e7c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:04.013167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:04.018799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:04.019523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:04.019739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:04.019861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:04.020063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:04.020640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:04.020806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:04.021104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:04.021225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:04.021550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:04.022776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:04.030200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:04.031930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:04.044977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:04.046259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:04.047392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:04.054141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 385/752] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:21:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:04.056111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:04.072350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 368/753] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 22 14:21:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:04.078576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:04.190445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4573-1047-40c6-a2f4-08bf3ab03dac None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:04.246341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:04.247314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:04.247314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:04.247490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:04.248244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:04.248707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:04.252767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:04.284927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:04.288492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 386/754] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 22 14:21:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:04.294289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:04.299840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c651f9-8b9f-4af1-9214-4865d9180415 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:04.348208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:04.374912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a18892-c71f-49d4-b958-0ec003145e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:04.375536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a18892-c71f-49d4-b958-0ec003145e13 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:04.375813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a18892-c71f-49d4-b958-0ec003145e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:04.376081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a18892-c71f-49d4-b958-0ec003145e13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:04.408463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ff51c-a58a-4041-bd0d-b7c8ebb32add None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:04.456266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8fbfb-92b1-4c95-b79e-786d3efc9f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:04.457525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fbfb-92b1-4c95-b79e-786d3efc9f07 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:04.458453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fbfb-92b1-4c95-b79e-786d3efc9f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:04.458729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fbfb-92b1-4c95-b79e-786d3efc9f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:04.465888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a18892-c71f-49d4-b958-0ec003145e13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:04.468086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a18892-c71f-49d4-b958-0ec003145e13 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:04.552239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8fbfb-92b1-4c95-b79e-786d3efc9f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:04.554615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8fbfb-92b1-4c95-b79e-786d3efc9f07 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:04.570100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:04.586094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 369/755] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 14:21:04.587752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd55c86-f40c-414a-bb6b-8debcc564265 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:04.588133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd55c86-f40c-414a-bb6b-8debcc564265 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:04.588557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd55c86-f40c-414a-bb6b-8debcc564265 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:04.590076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 370/756] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:04.596291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd55c86-f40c-414a-bb6b-8debcc564265 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:04.617846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:04.690963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 387/757] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 14:21:04.692974 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502c21-2041-41f6-862e-267051534df4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:04.693360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502c21-2041-41f6-862e-267051534df4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:04.693735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9502c21-2041-41f6-862e-267051534df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:04.715949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e9502c21-2041-41f6-862e-267051534df4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:04.716623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd55c86-f40c-414a-bb6b-8debcc564265 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:04.717812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e9502c21-2041-41f6-862e-267051534df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:04.755736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:04.756731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:04.757285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:04.757810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:04.769301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:04.771277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:04.787962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:04.789006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:04.789945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:04.789945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:04.789945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:04.797316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 371/758] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:04.798620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:04.799766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 388/759] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:04.800603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9502c21-2041-41f6-862e-267051534df4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:04.898344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:04.910348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:04.950192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9502c21-2041-41f6-862e-267051534df4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:04.987274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e63b47-9fcd-4ffe-940c-bf187b9557a0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.037654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.039652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.039930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.040202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.040855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:05.041159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.042560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.061195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.062376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.062654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.063036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.074150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 389/760] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:05.082247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.083742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.084908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:05.100082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:05.101116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:05.102340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:05.102340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:05.102340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:05.102340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 372/761] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:05.108834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.212269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8dab6-de45-4c82-acbb-24ed8605c514 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.242107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:05.253290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11578cd3-5584-4482-8e3d-5928da4bea73 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.258523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.259013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.259467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.259754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.263262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:05.268568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.270082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:05.282476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:05.283442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:05.284324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:05.284324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:05.284324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:05.284324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:05.284324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:05.284324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:05.284324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:05.284324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:05.288648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 390/762] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:05.289386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.299358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.300614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.301525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.302242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.302978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:05.303836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.306049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.324331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 373/763] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:05.326228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.406487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fe73e-b18f-4a9b-9a71-b0b7de72ca03 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.446892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.447572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.447852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.448124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.448731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.450405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:05.461684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:05.462792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:21:05.463621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:05.466972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b049ff9-b75d-40bd-97b6-e0d03e3ea5fb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.468452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 391/764] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:05.469410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.512787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.513736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.514355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.514829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.515739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:05.516763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.518786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.535003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 374/765] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:05.536196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.546308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:05.560653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:05.595573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10037d33-142f-4ca8-9927-5ed09ef76049 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.636134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.637498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.637929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.638369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.646121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.647758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.650182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8dc68-37da-4865-9165-8ac23af534ea None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:05.660553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:05.661660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:05.662812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:05.662812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:05.662812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:05.662812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:05.662812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:05.662812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:05.662812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:05.662812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:05.664564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 392/766] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:05.665488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.693043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6a760-a680-4945-880a-e0fb08d9cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.693651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a760-a680-4945-880a-e0fb08d9cba6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.693925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a760-a680-4945-880a-e0fb08d9cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.694218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a760-a680-4945-880a-e0fb08d9cba6 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.694851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6a760-a680-4945-880a-e0fb08d9cba6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:05.695152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6a760-a680-4945-880a-e0fb08d9cba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.696517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6a760-a680-4945-880a-e0fb08d9cba6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.701525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 375/767] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:05.703350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c31a1-ad3c-4531-8ea8-c43e20cc8e1f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.703630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c31a1-ad3c-4531-8ea8-c43e20cc8e1f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.703898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c31a1-ad3c-4531-8ea8-c43e20cc8e1f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.709238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 376/768] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:05.709935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c31a1-ad3c-4531-8ea8-c43e20cc8e1f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.786450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a42cfc-a535-4929-8288-e8c8eeb224ca None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.790833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:05.814280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:05.816542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c31a1-ad3c-4531-8ea8-c43e20cc8e1f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:05.830566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.831257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.831467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.831796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.832558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=3d98f829fb354c98a2e170d7f2a00874) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:05.833090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.835203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.849908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 393/769] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/role_assignments?user.id=3d98f829fb354c98a2e170d7f2a00874&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:05.849908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:05.869582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740124-16a8-428b-b1d5-be004ee0befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:05.870781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740124-16a8-428b-b1d5-be004ee0befc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.871136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740124-16a8-428b-b1d5-be004ee0befc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.871493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740124-16a8-428b-b1d5-be004ee0befc None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.872292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740124-16a8-428b-b1d5-be004ee0befc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:05.872681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740124-16a8-428b-b1d5-be004ee0befc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:05.875232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740124-16a8-428b-b1d5-be004ee0befc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:05.894016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 377/770] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:05.894016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12313-ec72-4199-8cdf-5446043e8ae2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:05.894016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12313-ec72-4199-8cdf-5446043e8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:05.894016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12313-ec72-4199-8cdf-5446043e8ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:05.912074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e7a12313-ec72-4199-8cdf-5446043e8ae2 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:05.913506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e7a12313-ec72-4199-8cdf-5446043e8ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:05.999768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350c015-3c33-4262-9a8b-13cbce828157 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:06.001894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 378/771] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:06.002848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12313-ec72-4199-8cdf-5446043e8ae2 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:06.054836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce2534-f239-4782-ad6e-09200278b96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:06.055377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce2534-f239-4782-ad6e-09200278b96c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.055814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce2534-f239-4782-ad6e-09200278b96c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.056093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce2534-f239-4782-ad6e-09200278b96c None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.056760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce2534-f239-4782-ad6e-09200278b96c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:06.057065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce2534-f239-4782-ad6e-09200278b96c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:06.058662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce2534-f239-4782-ad6e-09200278b96c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:06.066694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 394/772] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 22 14:21:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:06.067998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd899d5-e38f-4bff-b275-e1dfbdd74a14 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.068283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd899d5-e38f-4bff-b275-e1dfbdd74a14 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.068557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd899d5-e38f-4bff-b275-e1dfbdd74a14 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.070120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 395/773] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:06.072589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd899d5-e38f-4bff-b275-e1dfbdd74a14 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:06.095749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:06.141814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:06.147011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12313-ec72-4199-8cdf-5446043e8ae2 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:06.197500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dae022-30ea-4f16-bc44-26eecf5b32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:06.198266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae022-30ea-4f16-bc44-26eecf5b32bf None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.198878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae022-30ea-4f16-bc44-26eecf5b32bf None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.199217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dae022-30ea-4f16-bc44-26eecf5b32bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.200025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dae022-30ea-4f16-bc44-26eecf5b32bf None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=1b136a57b34c46e6b691d2a24e1288f9) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:06.200399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dae022-30ea-4f16-bc44-26eecf5b32bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:06.202957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dae022-30ea-4f16-bc44-26eecf5b32bf None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:06.205730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd899d5-e38f-4bff-b275-e1dfbdd74a14 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:06.214166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 379/774] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:06 2022] GET /identity/v3/role_assignments?user.id=1b136a57b34c46e6b691d2a24e1288f9&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:06.215865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c9f0-b482-4e8b-890d-fd526841c713 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.216341 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c9f0-b482-4e8b-890d-fd526841c713 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.216799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c9f0-b482-4e8b-890d-fd526841c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.259518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-01a7c9f0-b482-4e8b-890d-fd526841c713 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:06.263345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-01a7c9f0-b482-4e8b-890d-fd526841c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:06.279941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:06.280637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.280920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.281188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.281902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] RBAC: Adding query filter params (interface=public, service_id=eea6540ece4e4c7c9cc954d9c470fa3b, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:06.282230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:06.283604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:06.309604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 396/775] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 22 14:21:06 2022] GET /identity/v3/endpoints?service_id=eea6540ece4e4c7c9cc954d9c470fa3b&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:06.311933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:06.386185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 380/776] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:06.387803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c9f0-b482-4e8b-890d-fd526841c713 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:06.461511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4561a-6206-4e3f-8798-d11cc570caa3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:06.480754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:06.497414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:06.507349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:06.508364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.508906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.509370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] PATH_INFO: `/v3/services/network` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.510190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:06.511950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:06.534380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:06.535466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:21:06.536332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:06.540834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 397/777] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:06 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:06.547545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:06.588270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c9f0-b482-4e8b-890d-fd526841c713 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:06.627036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278ea0-faec-485a-91d6-01fba152f801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:06.628022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278ea0-faec-485a-91d6-01fba152f801 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.628516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278ea0-faec-485a-91d6-01fba152f801 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.629032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278ea0-faec-485a-91d6-01fba152f801 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.629856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be278ea0-faec-485a-91d6-01fba152f801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:06.631572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be278ea0-faec-485a-91d6-01fba152f801 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:06.638357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 381/778] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:21:06 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:06.713797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782bcd1-08ca-4762-928f-7e1c9b9ba1eb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:06.721968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278ea0-faec-485a-91d6-01fba152f801 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:06.782034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:06.782805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.783146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.783425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.784090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] RBAC: Adding query filter params (name=network) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:06.784399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:06.789267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:06.801072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 398/779] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:06.807014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:06.862935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:06.920287 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278ea0-faec-485a-91d6-01fba152f801 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:06.952673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:06.960955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4e91e-db8c-4021-9f74-828a240f0f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:06.966607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4e91e-db8c-4021-9f74-828a240f0f15 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:06.966607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4e91e-db8c-4021-9f74-828a240f0f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:06.966607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4e91e-db8c-4021-9f74-828a240f0f15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:06.966858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112e66b-e816-468c-be2b-ebbb19a7133b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:06.974461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4e91e-db8c-4021-9f74-828a240f0f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-acb4e91e-db8c-4021-9f74-828a240f0f15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:06.979704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:06.980650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:06.981617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:06.984466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 382/780] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:06.987469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4e91e-db8c-4021-9f74-828a240f0f15 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:07.010585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:07.011528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:07.011984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:07.012441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:07.013358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:07.013863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:07.016316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:07.022590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 399/781] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:07.029258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:07.098489 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4e91e-db8c-4021-9f74-828a240f0f15 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:07.136451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:07.136990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:07.137270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:07.137541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:07.138242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:07.138562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:07.140418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:07.149466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eb5ca-8f4a-46cd-b745-02dad5d955e5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:07.152294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:07.154148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 383/782] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:07.155521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:07.195101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:07.196039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:07.196496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:07.197019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:07.197997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] RBAC: Adding query filter params (interface=public, service_id=16cf174689d54489bed8392ac627c876, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:07.198489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:07.200331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:07.210826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:07.214864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 400/783] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 22 14:21:07 2022] GET /identity/v3/endpoints?service_id=16cf174689d54489bed8392ac627c876&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:07.220256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:07.284605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7289d0-c2af-484f-8f33-e9000ba87b66 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:07.325426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:07.326217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:07.326591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:07.327593 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:07.342052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:07.344400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:07.364242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:07.365274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:07.366214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:07.366214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:07.366214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:07.369957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 384/784] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:07.371288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:07.484735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f379c2-c3e3-4837-b9eb-7ecdd36043fb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:07.507947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32dae-56c3-438d-901f-ed369ced36d0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:07.514548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:07.540704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:07.541714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:07.542229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:07.542726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:07.543652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:07.544171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:07.546295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:07.561807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471be2be-4726-4b72-8219-7f1f7f9e5640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:07.562551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be2be-4726-4b72-8219-7f1f7f9e5640 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:07.562843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be2be-4726-4b72-8219-7f1f7f9e5640 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:07.563207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471be2be-4726-4b72-8219-7f1f7f9e5640 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:07.563781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471be2be-4726-4b72-8219-7f1f7f9e5640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:07.565166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471be2be-4726-4b72-8219-7f1f7f9e5640 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:07.580729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 401/786] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:21:07 2022] GET /identity/v3/services => generated 772 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:07.580983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 385/786] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:07.582825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471be2be-4726-4b72-8219-7f1f7f9e5640 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:07.621380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:07.711460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471be2be-4726-4b72-8219-7f1f7f9e5640 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:07.761366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:07.762027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:07.762301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:07.762567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:07.772738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:07.774261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:07.787144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:07.788161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:07.789130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:07.793105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 402/787] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:21:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:07.794536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:07.906292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85c58-9d6a-4edf-ba9b-b1f3bda387ce None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:07.943778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:07.944402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:07.944679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:07.945021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:07.945826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:07.946153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:07.947618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:07.970153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 386/788] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:21:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:07.973485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:08.078638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:08.087530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d654-7c9c-4447-a9f7-2157eff165d1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:08.125101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba739-87b8-4fb3-811a-470b171c6727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:08.125722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba739-87b8-4fb3-811a-470b171c6727 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:08.126018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba739-87b8-4fb3-811a-470b171c6727 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:08.126297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba739-87b8-4fb3-811a-470b171c6727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:08.198380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba739-87b8-4fb3-811a-470b171c6727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:08.199827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba739-87b8-4fb3-811a-470b171c6727 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:08.306385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:08.317243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 403/789] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:21:08.322087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:08.348285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:08.478406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a662f-7552-4df6-b0e5-9fb8d36d2012 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:08.521245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e0ed7-620d-408a-a991-61144560d695 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:08.521560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e0ed7-620d-408a-a991-61144560d695 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:08.521791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e0ed7-620d-408a-a991-61144560d695 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:08.523873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 404/790] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:08.526911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:08.527555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:08.527835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:08.528109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:08.528605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b6a9-171b-4b55-a113-1bfa2d2b0ced None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:08.528917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b6a9-171b-4b55-a113-1bfa2d2b0ced None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:08.529195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b6a9-171b-4b55-a113-1bfa2d2b0ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:08.547398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:08.548874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:08.551396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8e80b6a9-171b-4b55-a113-1bfa2d2b0ced None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:08.553227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8e80b6a9-171b-4b55-a113-1bfa2d2b0ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:08.572444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:08.573469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:08.574395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:08.574395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:08.574395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:08.582363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 387/791] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:08.590248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:08.634869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 405/792] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:08.761275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:08.806621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6a7b-a659-4675-9d99-ed8796bd526e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:08.852248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:08.852866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:08.853145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:08.853421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:08.854098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:08.854400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:08.855776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:08.873301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 388/793] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:08.878990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b6a9-171b-4b55-a113-1bfa2d2b0ced None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:09.035214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b6a9-171b-4b55-a113-1bfa2d2b0ced None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:09.044696 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:09.062487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:09.088990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:09.089707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.090018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.090345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.107086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:09.109174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:09.130267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:09.131233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:09.132145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:09.132145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:09.132145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:09.132145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:09.132145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:09.132145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:09.132145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:09.132145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:09.140276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 406/794] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:09.146019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:09.208597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14d99d-dff3-43d3-a1aa-4b9934d90c8d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:09.282369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:09.290941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26ac6f-cace-40c3-b181-eb34fb8206f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:09.291922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26ac6f-cace-40c3-b181-eb34fb8206f5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.292404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26ac6f-cace-40c3-b181-eb34fb8206f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.292873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26ac6f-cace-40c3-b181-eb34fb8206f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.317210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26ac6f-cace-40c3-b181-eb34fb8206f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0d26ac6f-cace-40c3-b181-eb34fb8206f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:09.329432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:09.330515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:09.331391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:09.337688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 389/795] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:09.343162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26ac6f-cace-40c3-b181-eb34fb8206f5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:09.356232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4d471-e5ba-4ccd-8e17-f762a0103fad None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:09.406718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a894c1-f450-42fc-ba17-663588007439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:09.407641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a894c1-f450-42fc-ba17-663588007439 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.407928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a894c1-f450-42fc-ba17-663588007439 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.408207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a894c1-f450-42fc-ba17-663588007439 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.408916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a894c1-f450-42fc-ba17-663588007439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:09.409228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a894c1-f450-42fc-ba17-663588007439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:09.410717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a894c1-f450-42fc-ba17-663588007439 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:09.430893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 407/796] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:09.430893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a2be-d108-4694-9d86-9d819e5108b1 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.430893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a2be-d108-4694-9d86-9d819e5108b1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.430893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a2be-d108-4694-9d86-9d819e5108b1 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.433755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 408/797] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:09.434626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a2be-d108-4694-9d86-9d819e5108b1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:09.466665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26ac6f-cace-40c3-b181-eb34fb8206f5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:09.483674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:09.503759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfb5f4-b817-4cde-8d4c-7e5c2d607008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:09.504372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb5f4-b817-4cde-8d4c-7e5c2d607008 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.504649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb5f4-b817-4cde-8d4c-7e5c2d607008 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.504919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfb5f4-b817-4cde-8d4c-7e5c2d607008 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.505584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfb5f4-b817-4cde-8d4c-7e5c2d607008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:09.505913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfb5f4-b817-4cde-8d4c-7e5c2d607008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:09.507353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfb5f4-b817-4cde-8d4c-7e5c2d607008 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:09.516847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 390/798] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:09.522448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efb2a0-e44f-4cec-980a-ff0e3f50ef98 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.522732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efb2a0-e44f-4cec-980a-ff0e3f50ef98 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.523002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efb2a0-e44f-4cec-980a-ff0e3f50ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.541968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e8efb2a0-e44f-4cec-980a-ff0e3f50ef98 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:09.543125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e8efb2a0-e44f-4cec-980a-ff0e3f50ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:09.548975 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a2be-d108-4694-9d86-9d819e5108b1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:09.593457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f4f73-b23b-45af-9112-976bc4ecf356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:09.594188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:09.594507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4f73-b23b-45af-9112-976bc4ecf356 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.594789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4f73-b23b-45af-9112-976bc4ecf356 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.595065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f4f73-b23b-45af-9112-976bc4ecf356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.595847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f4f73-b23b-45af-9112-976bc4ecf356 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=6bc75cc7beb54ef2abd4876b2b35675e) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:09.596315 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f4f73-b23b-45af-9112-976bc4ecf356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:09.597731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f4f73-b23b-45af-9112-976bc4ecf356 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:09.611530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 409/799] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:09 2022] GET /identity/v3/role_assignments?user.id=6bc75cc7beb54ef2abd4876b2b35675e&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:09.611530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7724830-3f72-4298-ab14-9fefea4dd79d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.611530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7724830-3f72-4298-ab14-9fefea4dd79d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.611530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7724830-3f72-4298-ab14-9fefea4dd79d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.611530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 410/800] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:09.611530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7724830-3f72-4298-ab14-9fefea4dd79d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:09.630433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 391/801] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:09.631928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754d00-8553-4078-86ae-7f0faba9a3b3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.632219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754d00-8553-4078-86ae-7f0faba9a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.632493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754d00-8553-4078-86ae-7f0faba9a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.679036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9d754d00-8553-4078-86ae-7f0faba9a3b3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:09.680283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9d754d00-8553-4078-86ae-7f0faba9a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:09.808621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7724830-3f72-4298-ab14-9fefea4dd79d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:09.818480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:09.844423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 392/802] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:09.853265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:09.854344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:09.854685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:09.855022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:09.867792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:09.869334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:09.885585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:09.887023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:09.887933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:09.887933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:09.887933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:09.887933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 411/803] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:09.893119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754d00-8553-4078-86ae-7f0faba9a3b3 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:09.931044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.012303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754d00-8553-4078-86ae-7f0faba9a3b3 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.030284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:10.052582 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b3b9-d4d6-40cb-a3a0-e57beb065c7e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.053501 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.054355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.054806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.055247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.056107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:10.056586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:10.058234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:10.072683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 393/804] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:10.082356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.098472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1381b1-a6cd-4066-8ccf-1330d190e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.099018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1381b1-a6cd-4066-8ccf-1330d190e118 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.099297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1381b1-a6cd-4066-8ccf-1330d190e118 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.099568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1381b1-a6cd-4066-8ccf-1330d190e118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.113436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1381b1-a6cd-4066-8ccf-1330d190e118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7b1381b1-a6cd-4066-8ccf-1330d190e118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:10.119770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:10.120791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:10.121668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 412/805] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:21:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:10.127908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1381b1-a6cd-4066-8ccf-1330d190e118 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.148501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:10.212500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eb145-bd24-4998-a887-de3f1c45f947 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.247070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1381b1-a6cd-4066-8ccf-1330d190e118 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.259725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.260672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.260957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.261239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.270820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:10.272268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:10.284367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:10.285428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 394/806] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:10.286846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.292144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a344a82-7d1f-4ec1-9b7f-282abd79da17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.292760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344a82-7d1f-4ec1-9b7f-282abd79da17 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.293035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344a82-7d1f-4ec1-9b7f-282abd79da17 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.293311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344a82-7d1f-4ec1-9b7f-282abd79da17 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.293998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a344a82-7d1f-4ec1-9b7f-282abd79da17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:10.294305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a344a82-7d1f-4ec1-9b7f-282abd79da17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:10.296222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a344a82-7d1f-4ec1-9b7f-282abd79da17 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:10.305591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 413/807] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:10.311798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dee01-7dd7-4e66-887b-7b6159ba7fab None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.312185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dee01-7dd7-4e66-887b-7b6159ba7fab None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.312460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dee01-7dd7-4e66-887b-7b6159ba7fab None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.313909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 414/808] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:10.314497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dee01-7dd7-4e66-887b-7b6159ba7fab None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.330189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:10.407407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb4b31-1f93-4f26-bce9-cbd4e1d671e2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.447963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.448627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.448905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.449175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.449780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:10.451534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:10.463877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:10.464973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:10.465852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 395/809] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:10.466733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.517610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:10.540902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dee01-7dd7-4e66-887b-7b6159ba7fab None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.570235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:10.577130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7784f-7737-4e61-bb88-d724ccf2e670 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.580136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29af30b-7513-4267-82b2-22496456d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.581894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29af30b-7513-4267-82b2-22496456d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.581894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29af30b-7513-4267-82b2-22496456d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.581894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29af30b-7513-4267-82b2-22496456d9f1 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.582172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29af30b-7513-4267-82b2-22496456d9f1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:10.582416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29af30b-7513-4267-82b2-22496456d9f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:10.583838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29af30b-7513-4267-82b2-22496456d9f1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:10.603422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 415/810] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:10.604767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83074e-d090-4c81-ac76-7069555b14c0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.605053 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83074e-d090-4c81-ac76-7069555b14c0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.605322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83074e-d090-4c81-ac76-7069555b14c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.619907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.620562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.620844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.621118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.624799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ff83074e-d090-4c81-ac76-7069555b14c0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:10.626049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ff83074e-d090-4c81-ac76-7069555b14c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:10.632281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:10.633767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:10.650604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:10.651625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:10.652554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:10.652554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:10.652554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:10.652554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 396/811] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:10.653413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.708449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 416/812] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:10.708449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83074e-d090-4c81-ac76-7069555b14c0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.789257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:10.792111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cacc3-0969-4a64-b4ae-2ed2d2cb7dd9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.833713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83074e-d090-4c81-ac76-7069555b14c0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:10.846700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.847333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.847620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.848176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.848823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:10.849639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:10.851661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:10.859214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 397/813] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:10.860148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:10.872850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:10.874226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:10.874577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:10.875073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:10.880431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:10.890544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:10.892222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:10.909427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:10.910675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:10.911806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:10.911806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:10.911806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:10.916643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 417/814] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:10.917594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.007526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1d21d-29ff-400b-a6a9-f90095b524ef None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.027818 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d587ec-2b26-459f-b592-90b15c0a3e94 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.046667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.047567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.047887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.048240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.048903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:11.049205 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.050710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.055462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:11.067837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 398/815] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:11.067837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.079317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.079959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.080528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.080813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.081456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:11.081759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.083176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.094187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 418/816] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 22 14:21:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:11.094845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.155811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:11.186577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8f73c-337e-4c77-b790-dc6ee92e3683 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.205109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199436-1d0e-4134-9c59-27ecc4459953 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.228168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.228791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.229066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.229335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.230015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:11.230311 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.231691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.245340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 399/817] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:11.246467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.258158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.258797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.259147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.259429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] PATH_INFO: `/v3/services/network` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.260019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.261385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:11.271143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:11.272209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:11.273088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 419/818] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:11.273904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.331846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:11.362836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572008d4-6370-46db-8f2e-34d85ab0decc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.392687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37d11-2e12-4fe7-a29c-fb14f120c707 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.395682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:11.400839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.401484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.401767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.402102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.410105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.411560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:11.423884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:11.425150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:11.426209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:11.430649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 400/819] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:11.431504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.439501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322ae3e-ea78-487e-a87a-b44e268bd907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.440389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322ae3e-ea78-487e-a87a-b44e268bd907 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.440832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322ae3e-ea78-487e-a87a-b44e268bd907 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.441255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322ae3e-ea78-487e-a87a-b44e268bd907 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.442105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322ae3e-ea78-487e-a87a-b44e268bd907 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.443648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322ae3e-ea78-487e-a87a-b44e268bd907 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.536634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076292e2-f41e-477f-81f1-1617fcacdc2b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.541253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 420/820] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:21:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:11.551761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322ae3e-ea78-487e-a87a-b44e268bd907 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.607604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.608925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.609215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.609495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.620552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.622448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:11.642161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:11.643151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:11.644090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:11.644090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:11.644090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:11.644090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:11.644090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:11.644090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:11.644090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:11.644090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:11.649201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 401/821] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:11.650274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.696459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322ae3e-ea78-487e-a87a-b44e268bd907 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.700632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:11.727589 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:11.742396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.743646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.743646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.743830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.744499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] RBAC: Adding query filter params (name=network) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:11.744808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.746209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.752446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 421/822] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:11.753398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.801938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c6aec-6089-4805-afb1-a0269a3da114 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.840009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.840628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.840912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.841184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.841922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:11.843043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.844562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.869906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 402/823] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:11.870859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.884522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbd19a-f6cb-4321-b56d-6821b0a4583e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:11.925400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:11.926105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:11.926806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:11.927083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:11.928090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:11.928403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:11.929861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:11.945085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 422/824] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:11.946406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:11.980490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:11.992058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0ef04-aeeb-4331-bcd1-b4baa3082a58 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:12.000780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:12.042030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:12.042030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.042030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.042030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.042440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] RBAC: Adding query filter params (type=network) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:12.042440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:12.044070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:12.057310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 403/825] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:12.058252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:12.067232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80090a-86e8-4eed-a7be-90764d04c388 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:12.111357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:12.112006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.112284 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.112555 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.124423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:12.125816 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:12.142875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:12.143912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:12.144856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:12.144856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:12.144856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:12.144856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 423/826] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:12.145098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:12.203935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d3a67-eb80-4168-8847-523dd1bc752a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:12.244463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:12.252335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e602-dbda-42c0-a853-d302210fccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:12.258968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e602-dbda-42c0-a853-d302210fccc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.258968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e602-dbda-42c0-a853-d302210fccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.258968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e602-dbda-42c0-a853-d302210fccc1 None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/3d98f829fb354c98a2e170d7f2a00874/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.258968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766e602-dbda-42c0-a853-d302210fccc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=3d98f829fb354c98a2e170d7f2a00874, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:12.258968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766e602-dbda-42c0-a853-d302210fccc1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:12.265292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff98036-edb5-4059-b5f3-7af5303d0c27 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:12.299963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd011-0e21-416a-909b-49e34155ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:12.300575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd011-0e21-416a-909b-49e34155ed19 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.300853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd011-0e21-416a-909b-49e34155ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.301124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd011-0e21-416a-909b-49e34155ed19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.301797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd011-0e21-416a-909b-49e34155ed19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:12.303225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd011-0e21-416a-909b-49e34155ed19 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:12.339650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 404/827] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:21:12 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/3d98f829fb354c98a2e170d7f2a00874/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:21:12.340480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e602-dbda-42c0-a853-d302210fccc1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:12.382975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:12.394539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 424/828] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:21:12 2022] POST /identity/v3/endpoints => generated 337 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:12.396543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739f90-f4dd-4a27-aa08-f8028bb751f9 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.397122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739f90-f4dd-4a27-aa08-f8028bb751f9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.397689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739f90-f4dd-4a27-aa08-f8028bb751f9 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.399781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 425/829] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:12.411300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a302-f294-4bca-9b27-9ed21fcca7dd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.412020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a302-f294-4bca-9b27-9ed21fcca7dd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.412492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299a302-f294-4bca-9b27-9ed21fcca7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.452679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5299a302-f294-4bca-9b27-9ed21fcca7dd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:12.454410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5299a302-f294-4bca-9b27-9ed21fcca7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:12.478158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e602-dbda-42c0-a853-d302210fccc1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:12.535122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:12.535756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.536033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.536302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.537050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:12.537358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:12.538867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:12.554879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 405/830] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:12.562681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:12.595798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 426/831] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:12.692661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:12.709646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6578fe4-d9f0-4a9e-9557-20a33bafd380 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:12.749402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:12.750069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.750349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.750757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.758094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:12.759552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:12.787618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:12.788585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:12.789494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 406/832] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:12.794544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299a302-f294-4bca-9b27-9ed21fcca7dd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:12.870553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:12.896214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:12.919035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299a302-f294-4bca-9b27-9ed21fcca7dd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:12.969175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:12.969175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:12.969175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:12.969175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:12.969997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:12.969997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:12.971861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:12.988919 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 427/833] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:12.994778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:13.034730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca7ffa-9c74-4184-b045-fb78910cbf25 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:13.080479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:13.081523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:13.082111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:13.082612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:13.083416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:13.085031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:13.095350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:13.096370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:13.097303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:13.105185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 407/834] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Sep 22 14:21:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:13.106473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:13.126403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:13.128164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9be2-6da6-4c77-adef-b7d2bd3ea494 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:13.158702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:13.168165 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e7967-2ed3-4b7c-923d-c2c86f7fa30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:13.168905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7967-2ed3-4b7c-923d-c2c86f7fa30a None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:13.169193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7967-2ed3-4b7c-923d-c2c86f7fa30a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:13.169468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7967-2ed3-4b7c-923d-c2c86f7fa30a None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/1b136a57b34c46e6b691d2a24e1288f9/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:13.188609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7967-2ed3-4b7c-923d-c2c86f7fa30a None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=1b136a57b34c46e6b691d2a24e1288f9, role_id=ec7a3b5dd84b4d68bde1443f1c0b3ca9)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:13.190116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e7967-2ed3-4b7c-923d-c2c86f7fa30a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:13.272241 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 428/835] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:21:12 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/1b136a57b34c46e6b691d2a24e1288f9/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:21:13.358804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1067833-cc0c-4459-913e-568a6d3fd8be None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:13.408170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd431678-bf45-4095-8f9e-17ebdfdd6e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:13.409632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431678-bf45-4095-8f9e-17ebdfdd6e29 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:13.410415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431678-bf45-4095-8f9e-17ebdfdd6e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:13.411170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431678-bf45-4095-8f9e-17ebdfdd6e29 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:13.414010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd431678-bf45-4095-8f9e-17ebdfdd6e29 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:13.414813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd431678-bf45-4095-8f9e-17ebdfdd6e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:13.417625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd431678-bf45-4095-8f9e-17ebdfdd6e29 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:13.428022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 408/836] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:13.438032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e7967-2ed3-4b7c-923d-c2c86f7fa30a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:13.564787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e7967-2ed3-4b7c-923d-c2c86f7fa30a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:13.602439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f5b06-9d23-403f-8d0e-4af32467d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:13.603054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f5b06-9d23-403f-8d0e-4af32467d67c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:13.603337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f5b06-9d23-403f-8d0e-4af32467d67c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:13.603612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f5b06-9d23-403f-8d0e-4af32467d67c None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:13.604253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f5b06-9d23-403f-8d0e-4af32467d67c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:13.604617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f5b06-9d23-403f-8d0e-4af32467d67c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:13.606005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f5b06-9d23-403f-8d0e-4af32467d67c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:13.612537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 429/837] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:14.056410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138d62-69a9-4f86-b394-cc4ed04147dd None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:14.056975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138d62-69a9-4f86-b394-cc4ed04147dd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:14.056975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e138d62-69a9-4f86-b394-cc4ed04147dd None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:14.058583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 409/838] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:14.066679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84571954-f5cd-4e0d-a217-710f10222c72 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:14.067191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84571954-f5cd-4e0d-a217-710f10222c72 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:14.067433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84571954-f5cd-4e0d-a217-710f10222c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:14.089062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-84571954-f5cd-4e0d-a217-710f10222c72 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:14.090272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-84571954-f5cd-4e0d-a217-710f10222c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:14.129656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:14.172155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 430/839] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:14.451700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e138d62-69a9-4f86-b394-cc4ed04147dd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:14.537566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:14.570006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e138d62-69a9-4f86-b394-cc4ed04147dd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:14.605615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:14.606280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:14.606552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:14.606816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:14.607399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:14.609379 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:14.618486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:14.620974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:14.623117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 410/840] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:14.631088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84571954-f5cd-4e0d-a217-710f10222c72 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:14.740796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84571954-f5cd-4e0d-a217-710f10222c72 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:14.780436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eccb55-baec-4645-aa1b-dafa9fc848b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:14.781051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccb55-baec-4645-aa1b-dafa9fc848b3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:14.781330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccb55-baec-4645-aa1b-dafa9fc848b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:14.781603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccb55-baec-4645-aa1b-dafa9fc848b3 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:14.782274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eccb55-baec-4645-aa1b-dafa9fc848b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:14.782564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eccb55-baec-4645-aa1b-dafa9fc848b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:14.783941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eccb55-baec-4645-aa1b-dafa9fc848b3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:14.789389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 431/841] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:14.800603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:14.914104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0a064-2446-445c-a002-33b09726b1ea None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:14.950321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce261f91-bdf6-4f7d-bcca-5a66e30af418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:14.950987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261f91-bdf6-4f7d-bcca-5a66e30af418 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:14.951824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261f91-bdf6-4f7d-bcca-5a66e30af418 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:14.952108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce261f91-bdf6-4f7d-bcca-5a66e30af418 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:14.952754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce261f91-bdf6-4f7d-bcca-5a66e30af418 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:14.953058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce261f91-bdf6-4f7d-bcca-5a66e30af418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:14.954465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce261f91-bdf6-4f7d-bcca-5a66e30af418 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:14.958601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a61-6e28-4faf-9f79-7cc5a115af40 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:14.959175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a61-6e28-4faf-9f79-7cc5a115af40 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:14.959452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c75a61-6e28-4faf-9f79-7cc5a115af40 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:14.960816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 411/842] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:14.961050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 432/843] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:14.966801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00775-60b5-40c5-935f-db86befad181 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:14.968187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00775-60b5-40c5-935f-db86befad181 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:14.968470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00775-60b5-40c5-935f-db86befad181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:14.975458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:14.990169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4fe00775-60b5-40c5-935f-db86befad181 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:14.992027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4fe00775-60b5-40c5-935f-db86befad181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:15.071251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 412/844] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:15.341185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75a61-6e28-4faf-9f79-7cc5a115af40 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:15.380364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:15.453211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c75a61-6e28-4faf-9f79-7cc5a115af40 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:15.489518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc411-9d63-4aaa-8f46-7473893f998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:15.490257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc411-9d63-4aaa-8f46-7473893f998f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:15.490542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc411-9d63-4aaa-8f46-7473893f998f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:15.490816 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc411-9d63-4aaa-8f46-7473893f998f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:15.502851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcc411-9d63-4aaa-8f46-7473893f998f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d8bcc411-9d63-4aaa-8f46-7473893f998f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:15.507725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:15.508700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:15.509956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 433/845] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:15.515375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00775-60b5-40c5-935f-db86befad181 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:15.624237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00775-60b5-40c5-935f-db86befad181 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:15.656556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:15.662756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022b010-87fa-4686-a177-9fb74459d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:15.663280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b010-87fa-4686-a177-9fb74459d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:15.663902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b010-87fa-4686-a177-9fb74459d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:15.664182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b010-87fa-4686-a177-9fb74459d8e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:15.664871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022b010-87fa-4686-a177-9fb74459d8e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:15.665178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022b010-87fa-4686-a177-9fb74459d8e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:15.666601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022b010-87fa-4686-a177-9fb74459d8e1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:15.677019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 413/846] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:15.683170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc411-9d63-4aaa-8f46-7473893f998f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:15.789690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:15.796570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc411-9d63-4aaa-8f46-7473893f998f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:15.815299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f0a96-2b11-44d8-93e3-fffa47acaa07 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:15.815946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f0a96-2b11-44d8-93e3-fffa47acaa07 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:15.816453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f0a96-2b11-44d8-93e3-fffa47acaa07 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:15.819494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 414/847] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:15.824114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6552aa-347d-4d4a-a996-f292a45240bf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:15.824680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6552aa-347d-4d4a-a996-f292a45240bf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:15.825164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6552aa-347d-4d4a-a996-f292a45240bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:15.836801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:15.837449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:15.837734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:15.838032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:15.847600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9a6552aa-347d-4d4a-a996-f292a45240bf None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:15.849214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9a6552aa-347d-4d4a-a996-f292a45240bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:15.850246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:15.851961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:15.876080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:15.877153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:15.878967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:15.878967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:15.878967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:15.878967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 434/848] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:15.883162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:15.950600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 415/849] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:16.005368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb855-c9d8-4ffb-a635-70a69495d552 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:16.036880 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d94c-b73c-4026-bd8f-04add1df6de0 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.037233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d94c-b73c-4026-bd8f-04add1df6de0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.037431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650d94c-b73c-4026-bd8f-04add1df6de0 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.038943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 416/850] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:16.044904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf354c-7bd4-4b7a-bf0a-ad3795eee067 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.045105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf354c-7bd4-4b7a-bf0a-ad3795eee067 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.045321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf354c-7bd4-4b7a-bf0a-ad3795eee067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.046750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:16.047603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.048114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.048590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.049469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:16.050021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:16.051880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:16.066236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 435/851] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:16.066720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f5bf354c-7bd4-4b7a-bf0a-ad3795eee067 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:16.068095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f5bf354c-7bd4-4b7a-bf0a-ad3795eee067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:16.071447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:16.082022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:16.153396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 417/852] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:16.184105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4da037-dce2-47b4-b3fa-e43689d4e24c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:16.222904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:16.223859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.224304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.224728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.234490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:16.236210 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:16.250977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:16.252195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:16.253389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 436/853] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:16.257897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf354c-7bd4-4b7a-bf0a-ad3795eee067 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:16.260784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:16.322387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:16.338393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:16.372776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf354c-7bd4-4b7a-bf0a-ad3795eee067 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:16.377905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323704e6-74c8-4424-9397-33621b77a09b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:16.410025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:16.410791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.411154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.411428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.412163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:16.412472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:16.413898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:16.414648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb41278-9a23-4236-9dd6-29fa73aad32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:16.415399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb41278-9a23-4236-9dd6-29fa73aad32c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.415872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb41278-9a23-4236-9dd6-29fa73aad32c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.416242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb41278-9a23-4236-9dd6-29fa73aad32c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.428882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb41278-9a23-4236-9dd6-29fa73aad32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1cb41278-9a23-4236-9dd6-29fa73aad32c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:16.437899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:16.439849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:21:16.441246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:16.442608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 418/854] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 22 14:21:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:16.442608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:16.442776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 437/855] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:21:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:16.444615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb41278-9a23-4236-9dd6-29fa73aad32c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:16.549894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3572f2-57f7-47fd-95a2-698e782c9195 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:16.563104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:16.564101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb41278-9a23-4236-9dd6-29fa73aad32c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:16.584630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593bf0-0143-4d82-8b95-19659c09afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:16.585232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593bf0-0143-4d82-8b95-19659c09afb8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.585445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593bf0-0143-4d82-8b95-19659c09afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.585714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593bf0-0143-4d82-8b95-19659c09afb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.592337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:16.601958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847115c0-3586-4222-86ec-926c5e16e1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:16.602805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847115c0-3586-4222-86ec-926c5e16e1a8 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.603329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847115c0-3586-4222-86ec-926c5e16e1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.603777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847115c0-3586-4222-86ec-926c5e16e1a8 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.604653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847115c0-3586-4222-86ec-926c5e16e1a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:16.606254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847115c0-3586-4222-86ec-926c5e16e1a8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:16.655157 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42593bf0-0143-4d82-8b95-19659c09afb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:16.656618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42593bf0-0143-4d82-8b95-19659c09afb8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:16.695849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 438/856] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:21:16 2022] POST /identity/v3/services => generated 269 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:16.695849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847115c0-3586-4222-86ec-926c5e16e1a8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:16.781030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 419/857] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:21:16.782505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593bf0-0143-4d82-8b95-19659c09afb8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:16.799025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:16.815242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847115c0-3586-4222-86ec-926c5e16e1a8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:16.856256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:16.857129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.857961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.858709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.859832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:16.860309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:16.862167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:16.871753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 439/858] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:21:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:16.878498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:16.917608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593bf0-0143-4d82-8b95-19659c09afb8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:16.940848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:16.960613 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:16.962331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:16.962331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:16.962331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:16.981313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:16.983877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:17.004651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:17.005717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:17.006987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:17.006987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:17.006987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:17.006987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 420/859] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:17.012137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.014576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cbb87-796a-4ab3-bb40-b3928ef7678e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.051587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.052583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.053063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.053571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.065845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:17.067617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.077885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:17.083054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:17.083997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:17.084889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:17.084889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:17.084889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:17.087028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 440/860] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:17.092485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.134287 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119a78-d384-486c-9bfa-ebbf7526023d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.177044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.177765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.178110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.178435 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.179214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:17.179698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:17.181605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.197930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 421/861] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:17.204163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.218586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:17.224337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a6acc-d722-48c2-bb3b-a31e70b113ac None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.270344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.271391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.271968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.272460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.273318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:17.273849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:17.276444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.294234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 441/862] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:17.300093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.335495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5994cf-c30d-4fd7-97cd-9c6039948d70 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.366119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:17.377581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c579bc3-cfcb-4248-95cb-3e15fd777cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.378256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579bc3-cfcb-4248-95cb-3e15fd777cfb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.381220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579bc3-cfcb-4248-95cb-3e15fd777cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.381220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579bc3-cfcb-4248-95cb-3e15fd777cfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.385586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c579bc3-cfcb-4248-95cb-3e15fd777cfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:17.386987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c579bc3-cfcb-4248-95cb-3e15fd777cfb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-1c579bc3-cfcb-4248-95cb-3e15fd777cfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:17.398599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:17.399878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 422/863] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:17.401010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b045-abcb-4d75-a035-f3defb7b69c9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.401669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b045-abcb-4d75-a035-f3defb7b69c9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.401669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6b045-abcb-4d75-a035-f3defb7b69c9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.402860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 423/864] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:17.405618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6b045-abcb-4d75-a035-f3defb7b69c9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.428649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35009c-8e19-4373-b19c-0a7d31b4e23a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.475044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b153-6fe9-4a33-b8de-21101ce62882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.475772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b153-6fe9-4a33-b8de-21101ce62882 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.476356 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b153-6fe9-4a33-b8de-21101ce62882 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.476690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b153-6fe9-4a33-b8de-21101ce62882 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.484554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b153-6fe9-4a33-b8de-21101ce62882 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:17.486102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b153-6fe9-4a33-b8de-21101ce62882 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ed76b153-6fe9-4a33-b8de-21101ce62882 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:17.497568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:17.499261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:17.500285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:17.503952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 442/865] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:21:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:17.505514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104add-5888-46ec-bf5c-fe44d0af90f0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.505514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104add-5888-46ec-bf5c-fe44d0af90f0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.505796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7104add-5888-46ec-bf5c-fe44d0af90f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.516985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6b045-abcb-4d75-a035-f3defb7b69c9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.524222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a7104add-5888-46ec-bf5c-fe44d0af90f0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:17.525402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a7104add-5888-46ec-bf5c-fe44d0af90f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:17.538013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:17.553646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.554287 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.554566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.554839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.555527 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:17.555829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:17.557243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.570467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 424/866] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:17.571289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.620467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:17.621536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 443/867] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:17 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:17.622211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7104add-5888-46ec-bf5c-fe44d0af90f0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.707871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfafca-0bd0-47d3-a4bc-d558c5fb0703 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.733457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7104add-5888-46ec-bf5c-fe44d0af90f0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.764609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.766253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.766765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.767276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.769130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:17.769899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:17.771985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.773715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.774495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.774847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.775214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:17.776637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=3d98f829fb354c98a2e170d7f2a00874) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:17.776637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:17.777908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:17.784651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 444/868] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:17 2022] GET /identity/v3/role_assignments?user.id=3d98f829fb354c98a2e170d7f2a00874&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:17.794763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 425/869] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 22 14:21:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:17.801628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.817878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:17.919425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:17.933297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa22bac-dbee-4797-b188-d5f6fa7eb040 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:17.986803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5e94a-cfeb-4ab5-b4ef-b79a1ba3a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:17.987420 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5e94a-cfeb-4ab5-b4ef-b79a1ba3a4fc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:17.987697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5e94a-cfeb-4ab5-b4ef-b79a1ba3a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:17.987973 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5e94a-cfeb-4ab5-b4ef-b79a1ba3a4fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:18.049218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fc795-9880-45c3-af80-6fbb1cbfe832 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:18.050846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:18.079206 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5e94a-cfeb-4ab5-b4ef-b79a1ba3a4fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:18.080657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5e94a-cfeb-4ab5-b4ef-b79a1ba3a4fc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:18.093117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5335d7-033b-4833-bc0f-c04883ea956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:18.093733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5335d7-033b-4833-bc0f-c04883ea956b None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:18.094024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5335d7-033b-4833-bc0f-c04883ea956b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:18.094300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5335d7-033b-4833-bc0f-c04883ea956b None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:18.095028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:18.095849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5335d7-033b-4833-bc0f-c04883ea956b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:18.097368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5335d7-033b-4833-bc0f-c04883ea956b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:18.197186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 445/870] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:17 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:21:18.203890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5e94a-cfeb-4ab5-b4ef-b79a1ba3a4fc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:18.211838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 426/871] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:21:17 2022] POST /identity/v3/services => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:21:18.339712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5e94a-cfeb-4ab5-b4ef-b79a1ba3a4fc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:18.352603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:18.384486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:18.385126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:18.385402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:18.385669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:18.397680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:18.399267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:18.416896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:18.417951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:18.418927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:18.418927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:18.418927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:18.418927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 446/872] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:18.424889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5335d7-033b-4833-bc0f-c04883ea956b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:18.543190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5335d7-033b-4833-bc0f-c04883ea956b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:18.581823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:18.582856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:18.583316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:18.583817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:18.584687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:18.585177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:18.586820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:18.604053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 427/873] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:18.607173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:18.717145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb79a55-0f55-47bb-a73c-505084c463df None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:18.753671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:18.754369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:18.754706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:18.755038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:18.762499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:18.764086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:18.776439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:18.777389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:18.778644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 447/874] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:18.787436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:18.815439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:18.899036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791d16f-785b-4f51-aa90-818b9a81f213 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:18.938746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c7eab-b097-40de-b23f-176ad56e47c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:18.939632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c7eab-b097-40de-b23f-176ad56e47c3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:18.939914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c7eab-b097-40de-b23f-176ad56e47c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:18.940186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c7eab-b097-40de-b23f-176ad56e47c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:18.940973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c7eab-b097-40de-b23f-176ad56e47c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:18.941310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c7eab-b097-40de-b23f-176ad56e47c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:18.942818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c7eab-b097-40de-b23f-176ad56e47c3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:18.956402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 428/875] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:18.962844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:18.999963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:19.074804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5aad69-1fef-4b00-be56-224825343b91 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:19.112384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b2a49-2c82-4d08-9d20-1a63ea4dac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:19.113468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2a49-2c82-4d08-9d20-1a63ea4dac71 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:19.113961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2a49-2c82-4d08-9d20-1a63ea4dac71 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:19.114474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b2a49-2c82-4d08-9d20-1a63ea4dac71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:19.115410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b2a49-2c82-4d08-9d20-1a63ea4dac71 None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=1b136a57b34c46e6b691d2a24e1288f9) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:19.115921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b2a49-2c82-4d08-9d20-1a63ea4dac71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:19.117558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b2a49-2c82-4d08-9d20-1a63ea4dac71 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:19.130124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 448/876] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:18 2022] GET /identity/v3/role_assignments?user.id=1b136a57b34c46e6b691d2a24e1288f9&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:19.182815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959cad-4b4c-4bbe-ba18-ad5944a71b7d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:19.183152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959cad-4b4c-4bbe-ba18-ad5944a71b7d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:19.183378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88959cad-4b4c-4bbe-ba18-ad5944a71b7d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:19.185091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 429/877] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:19.192142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535f212-9432-4cd1-a757-7df093cdf300 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:19.192812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535f212-9432-4cd1-a757-7df093cdf300 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:19.193301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535f212-9432-4cd1-a757-7df093cdf300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:19.214397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3535f212-9432-4cd1-a757-7df093cdf300 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:19.216031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3535f212-9432-4cd1-a757-7df093cdf300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:19.305269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 449/878] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:19.591692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959cad-4b4c-4bbe-ba18-ad5944a71b7d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:19.694514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:19.715488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88959cad-4b4c-4bbe-ba18-ad5944a71b7d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:19.755127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:19.755766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:19.756049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:19.756324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:19.756916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:19.760329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:19.771608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:19.772626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:19.773540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 430/879] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Sep 22 14:21:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:19.778937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535f212-9432-4cd1-a757-7df093cdf300 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:19.807890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:19.903954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535f212-9432-4cd1-a757-7df093cdf300 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:19.943004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:19.943965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:19.944431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:19.944877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:19.945680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:19.946186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:19.947792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:19.953375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 450/880] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:19.958945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:20.073274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd33cc-32d9-4a4c-af98-22a756fc620b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:20.124077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cdab9-dbc2-456f-99e3-a5368eddb691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:20.126875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cdab9-dbc2-456f-99e3-a5368eddb691 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.127193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cdab9-dbc2-456f-99e3-a5368eddb691 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.127507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cdab9-dbc2-456f-99e3-a5368eddb691 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.128256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cdab9-dbc2-456f-99e3-a5368eddb691 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:20.128603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cdab9-dbc2-456f-99e3-a5368eddb691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:20.130191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cdab9-dbc2-456f-99e3-a5368eddb691 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:20.137747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 431/881] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:20.148709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:20.208357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca895c4-ff7b-44cb-a5cb-08d13de5e585 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.208547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca895c4-ff7b-44cb-a5cb-08d13de5e585 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.209425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca895c4-ff7b-44cb-a5cb-08d13de5e585 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.211136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 432/882] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:20.216473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ae0d4-602f-4e88-baea-ba786ae14ce9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.216810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ae0d4-602f-4e88-baea-ba786ae14ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.217750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ae0d4-602f-4e88-baea-ba786ae14ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.245926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-073ae0d4-602f-4e88-baea-ba786ae14ce9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:20.247195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-073ae0d4-602f-4e88-baea-ba786ae14ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:20.251357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:20.260052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:20.290853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b414b5-f36f-4783-8a35-bff9e97e84f3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:20.339499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:20.339499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.339499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.339499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.339926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] RBAC: Adding query filter params (interface=public, service_id=236e6b42eef24539b049792ab9cc4532, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:20.339926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:20.339926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:20.340844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 433/883] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:20.344658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 451/884] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 22 14:21:20 2022] GET /identity/v3/endpoints?service_id=236e6b42eef24539b049792ab9cc4532&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:20.350605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ae0d4-602f-4e88-baea-ba786ae14ce9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:20.458723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ae0d4-602f-4e88-baea-ba786ae14ce9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:20.495187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512c18c-d652-4af4-bf9b-c3abbcbd3731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:20.495799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c18c-d652-4af4-bf9b-c3abbcbd3731 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.496075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c18c-d652-4af4-bf9b-c3abbcbd3731 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.496347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c18c-d652-4af4-bf9b-c3abbcbd3731 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.497017 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512c18c-d652-4af4-bf9b-c3abbcbd3731 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:20.499236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512c18c-d652-4af4-bf9b-c3abbcbd3731 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:20.505767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 434/885] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:21:20 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:21:20.617262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:20.735529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402ab89-fe05-458d-b878-c2851b510e50 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:20.740959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc35801-170c-4f53-ae7b-7b4a38c94bfb None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.741849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc35801-170c-4f53-ae7b-7b4a38c94bfb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.742363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc35801-170c-4f53-ae7b-7b4a38c94bfb None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.744183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 435/886] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:20.749876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586db6-4ea0-49b8-9f82-d68d85167b12 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.750458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586db6-4ea0-49b8-9f82-d68d85167b12 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.750945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11586db6-4ea0-49b8-9f82-d68d85167b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.758652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:20.770550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-11586db6-4ea0-49b8-9f82-d68d85167b12 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:20.772141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-11586db6-4ea0-49b8-9f82-d68d85167b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:20.774564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:20.775199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.775478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.775752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.776336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:20.777690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:20.787776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:20.789226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:20.790190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 452/887] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:20.796886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:20.805237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:20.854236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 436/888] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:20.920515 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e959f-e025-40fd-9a25-3cff9c214786 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:20.958173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:20.958896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:20.959230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:20.959544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:20.960286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:20.960596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:20.962225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:20.969269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 453/889] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:20.975642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11586db6-4ea0-49b8-9f82-d68d85167b12 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:21.101662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11586db6-4ea0-49b8-9f82-d68d85167b12 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:21.142738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:21.148814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:21.149430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:21.149709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:21.149993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:21.150699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:21.151002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:21.152370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:21.155707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:21.159029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 437/890] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:21.246388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:21.266148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30b9e9-04d8-47de-b481-fefa609d514e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:21.307877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:21.308669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:21.308977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:21.309281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:21.309940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:21.312270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:21.323413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:21.324472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:21.325324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 454/891] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:21.332895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:21.452040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf979-1fb8-4fb2-9e17-451c9a4ad137 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:21.490413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2811f1b-6af4-46ea-be0a-08a071a0a283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:21.491386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811f1b-6af4-46ea-be0a-08a071a0a283 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:21.491884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811f1b-6af4-46ea-be0a-08a071a0a283 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:21.492376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2811f1b-6af4-46ea-be0a-08a071a0a283 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:21.493217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2811f1b-6af4-46ea-be0a-08a071a0a283 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:21.493728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2811f1b-6af4-46ea-be0a-08a071a0a283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:21.495390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2811f1b-6af4-46ea-be0a-08a071a0a283 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:21.502616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 438/892] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:21.509140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:21.511684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e083b-3322-4eaf-90fa-992ab2f6efe4 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:21.511968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e083b-3322-4eaf-90fa-992ab2f6efe4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:21.512314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e083b-3322-4eaf-90fa-992ab2f6efe4 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:21.514940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 439/893] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:21.519322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4773-5145-4b9e-b493-e6d35b0e4669 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:21.519599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4773-5145-4b9e-b493-e6d35b0e4669 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:21.519922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4773-5145-4b9e-b493-e6d35b0e4669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:21.539475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7d6c4773-5145-4b9e-b493-e6d35b0e4669 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:21.540813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7d6c4773-5145-4b9e-b493-e6d35b0e4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:21.610915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:21.630298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 440/894] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:21.632907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b48dca-ea46-4c6a-8d79-69ca155f65c4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:21.670493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:21.671260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:21.671553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:21.671870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:21.672567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:21.672849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:21.674235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:21.679523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 455/895] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:21.682311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:21.687827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c4773-5145-4b9e-b493-e6d35b0e4669 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:21.800666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c4773-5145-4b9e-b493-e6d35b0e4669 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:21.836553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:21.837166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:21.837445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:21.837715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:21.838450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] RBAC: Adding query filter params (interface=public, service_id=bb2bc04e9b60469ba5af5c1c6d7c332b, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:21.838761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:21.840124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:21.848798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 441/896] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 22 14:21:21 2022] GET /identity/v3/endpoints?service_id=bb2bc04e9b60469ba5af5c1c6d7c332b&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:21.855071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:21.913362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:21.968379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a2b90-262d-49aa-9389-395e8b128a5d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:21.988761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:22.007500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087577e2-daf9-4f60-8cf1-bc0eb315c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:22.007928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087577e2-daf9-4f60-8cf1-bc0eb315c5bf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.008209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087577e2-daf9-4f60-8cf1-bc0eb315c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.008500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087577e2-daf9-4f60-8cf1-bc0eb315c5bf None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.009243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087577e2-daf9-4f60-8cf1-bc0eb315c5bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:22.010998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087577e2-daf9-4f60-8cf1-bc0eb315c5bf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:22.026178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 456/897] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:21:21 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:21:22.043604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1249-654d-4add-89d0-3524071df9b1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:22.083897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc383050-6d2f-4028-8b60-711f439facf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:22.084800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc383050-6d2f-4028-8b60-711f439facf9 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.085259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc383050-6d2f-4028-8b60-711f439facf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.085694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc383050-6d2f-4028-8b60-711f439facf9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.099076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc383050-6d2f-4028-8b60-711f439facf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-fc383050-6d2f-4028-8b60-711f439facf9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:22.105049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:22.106297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:22.107451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:22.110100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 442/898] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 22 14:21:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:22.120299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087577e2-daf9-4f60-8cf1-bc0eb315c5bf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:22.188528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:22.246084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087577e2-daf9-4f60-8cf1-bc0eb315c5bf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:22.283935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:22.284543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.284817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.285136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.285794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:22.286124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:22.287489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:22.296583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 457/899] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 22 14:21:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:22.302305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc383050-6d2f-4028-8b60-711f439facf9 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:22.407854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc383050-6d2f-4028-8b60-711f439facf9 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:22.425000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:22.443061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:22.443700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.443981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.444254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.456114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:22.457705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:22.473026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:22.474046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:22.474976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:22.474976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:22.474976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:22.474976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 443/900] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:22.479891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:22.586075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f1e3a-5b15-49b1-bd24-b1f6ec322f61 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:22.611150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:22.623046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829f56c-1a9b-4c50-a6b5-1802cde84af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:22.623654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829f56c-1a9b-4c50-a6b5-1802cde84af6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.623933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829f56c-1a9b-4c50-a6b5-1802cde84af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.624190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829f56c-1a9b-4c50-a6b5-1802cde84af6 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.624832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829f56c-1a9b-4c50-a6b5-1802cde84af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:22.625189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829f56c-1a9b-4c50-a6b5-1802cde84af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:22.626616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829f56c-1a9b-4c50-a6b5-1802cde84af6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:22.640072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 458/901] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:22.645619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:22.753218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b5e09-e144-459f-bfe3-e4c334715b57 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:22.787615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:22.788539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.788985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.789411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.799068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:22.800716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:22.813127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:22.814299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:22.815441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:22.817609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 444/902] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:21:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:22.823191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e9b7-a026-4406-97be-c392a5246c90 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.823436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:22.823546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e9b7-a026-4406-97be-c392a5246c90 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.823742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e9b7-a026-4406-97be-c392a5246c90 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.825308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 459/903] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:22.831408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663ab2-3d8f-4419-8009-33994866af35 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.831693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663ab2-3d8f-4419-8009-33994866af35 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.831970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663ab2-3d8f-4419-8009-33994866af35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.851399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0c663ab2-3d8f-4419-8009-33994866af35 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:22.852595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0c663ab2-3d8f-4419-8009-33994866af35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:22.858126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:22.930158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 460/904] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:22.946553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd850d48-6e9f-4c9a-ac34-31c34bfb0f83 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:22.983238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:22.984136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:22.984567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:22.984976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:22.985865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:22.986331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:22.987893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:23.008031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 445/905] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 22 14:21:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:23.015414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c663ab2-3d8f-4419-8009-33994866af35 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:23.122202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c663ab2-3d8f-4419-8009-33994866af35 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:23.136366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:23.159155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce298e-6151-4c02-910f-2e0db118c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:23.160025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce298e-6151-4c02-910f-2e0db118c232 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.160459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce298e-6151-4c02-910f-2e0db118c232 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.160873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce298e-6151-4c02-910f-2e0db118c232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.196701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:23.238684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce298e-6151-4c02-910f-2e0db118c232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:23.240386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce298e-6151-4c02-910f-2e0db118c232 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:23.304203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:23.322135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294cae4-9a70-40cd-b0c7-ed01b05d8490 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:23.360557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 461/906] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:23 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:21:23.361740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce298e-6151-4c02-910f-2e0db118c232 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:23.365019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:23.366493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.366493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.366493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.366914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:23.368336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:23.378509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:23.379728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:23.380670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 446/907] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Sep 22 14:21:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:23.382237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:23.385581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:23.494230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce298e-6151-4c02-910f-2e0db118c232 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:23.528747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291b08-e49e-4940-9d78-00f86c97f1b2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:23.533793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a3113-d551-49cd-9a50-b4409f2173e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:23.534581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3113-d551-49cd-9a50-b4409f2173e0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.534959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3113-d551-49cd-9a50-b4409f2173e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.535331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3113-d551-49cd-9a50-b4409f2173e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.547852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a3113-d551-49cd-9a50-b4409f2173e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:23.549963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a3113-d551-49cd-9a50-b4409f2173e0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ff2a3113-d551-49cd-9a50-b4409f2173e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:23.568501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:23.569662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:23.570610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:23.570610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:23.570610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:23.570610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 462/908] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:23.572743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177a75-f7a1-4909-9d07-a240cb668ddc None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.573140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177a75-f7a1-4909-9d07-a240cb668ddc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.573511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b189f-6c28-4fbb-af78-06acdfb4a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:23.573704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177a75-f7a1-4909-9d07-a240cb668ddc None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.574903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b189f-6c28-4fbb-af78-06acdfb4a78a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.575304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 463/909] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:23.575542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b189f-6c28-4fbb-af78-06acdfb4a78a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.575812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b189f-6c28-4fbb-af78-06acdfb4a78a None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.577418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b189f-6c28-4fbb-af78-06acdfb4a78a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:23.577716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc177a75-f7a1-4909-9d07-a240cb668ddc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:23.577837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b189f-6c28-4fbb-af78-06acdfb4a78a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:23.579351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b189f-6c28-4fbb-af78-06acdfb4a78a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:23.586249 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 447/910] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:23.590786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab86d-1631-425c-bfe0-ab0bfcdc8231 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.590786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab86d-1631-425c-bfe0-ab0bfcdc8231 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.590786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab86d-1631-425c-bfe0-ab0bfcdc8231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.606463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-82cab86d-1631-425c-bfe0-ab0bfcdc8231 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:23.608240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-82cab86d-1631-425c-bfe0-ab0bfcdc8231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:23.618012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:23.653691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:23.683070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 448/911] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:23.683733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cab86d-1631-425c-bfe0-ab0bfcdc8231 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:23.710821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc177a75-f7a1-4909-9d07-a240cb668ddc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:23.762251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:23.764063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.764557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.765059 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.766450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:23.767386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:23.769366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:23.787842 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 464/912] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:23.789208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cab86d-1631-425c-bfe0-ab0bfcdc8231 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:23.794025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:23.843823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:23.845192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.846201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.846702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.848012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:23.848656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:23.851227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:23.861724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 449/913] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:23.866852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:23.883749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:23.931059 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414ce7e-fe13-4218-80ee-23bc120253df None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:23.965074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:23.978281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:23.978930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:23.979220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:23.979473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:23.986961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:23.988401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:24.002472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:24.003491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:24.004496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:24.004496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:24.004496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:24.004496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:24.004496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:24.004496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:24.004496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:24.004496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:24.006135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 465/914] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:24.008058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:24.017242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65f99-b16a-49f3-a36c-3a9ef09ea0d6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:24.055003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab154e-a5ef-45e2-9a69-2197be70c7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:24.055657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab154e-a5ef-45e2-9a69-2197be70c7c7 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:24.056001 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab154e-a5ef-45e2-9a69-2197be70c7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:24.056328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab154e-a5ef-45e2-9a69-2197be70c7c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:24.057016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab154e-a5ef-45e2-9a69-2197be70c7c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:24.058494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab154e-a5ef-45e2-9a69-2197be70c7c7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:24.118684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfac5-9dd0-4533-8294-485a8228f514 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:24.146009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 450/915] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:21:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:21:24.146009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab154e-a5ef-45e2-9a69-2197be70c7c7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:24.184473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f183ebe-48ad-4132-8555-91951a086448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:24.185195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183ebe-48ad-4132-8555-91951a086448 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:24.186211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183ebe-48ad-4132-8555-91951a086448 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:24.186211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183ebe-48ad-4132-8555-91951a086448 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:24.186933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f183ebe-48ad-4132-8555-91951a086448 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:24.188414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f183ebe-48ad-4132-8555-91951a086448 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:24.241252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:24.258857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 466/916] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:21:24 2022] POST /identity/v3/services => generated 241 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:24.299727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab154e-a5ef-45e2-9a69-2197be70c7c7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:24.346015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4817-d244-42b8-868e-1977c95ddf07 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:24.346391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4817-d244-42b8-868e-1977c95ddf07 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:24.346622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da4817-d244-42b8-868e-1977c95ddf07 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:24.348935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:24.349573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:24.349700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 467/917] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:24.349908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:24.350148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:24.351122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:24.351432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:24.352997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:24.354624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2018f5-9eb4-4b66-983c-173a500554f8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:24.354911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2018f5-9eb4-4b66-983c-173a500554f8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:24.355186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2018f5-9eb4-4b66-983c-173a500554f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:24.371070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 451/918] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:24.377528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:24.377716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1a2018f5-9eb4-4b66-983c-173a500554f8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:24.378853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1a2018f5-9eb4-4b66-983c-173a500554f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:24.427042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:24.473003 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 468/919] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:24.507096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482590-96cc-443e-b3f6-64c9887595eb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:24.529054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:24.545426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:24.546363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:24.546866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:24.547346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:24.548333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] RBAC: Adding query filter params (role.id=8cd79564c7de4789b67106a74a9ae9ff, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=1b136a57b34c46e6b691d2a24e1288f9) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:24.548828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:24.550664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:24.557421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 452/920] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:24 2022] GET /identity/v3/role_assignments?user.id=1b136a57b34c46e6b691d2a24e1288f9&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=8cd79564c7de4789b67106a74a9ae9ff => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:24.759663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2018f5-9eb4-4b66-983c-173a500554f8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:24.865713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2018f5-9eb4-4b66-983c-173a500554f8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:24.904867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:24.905583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:24.905818 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:24.906072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:24.906660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:24.908013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:24.917365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:24.918503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:24.919497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 469/921] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:24.928490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:25.043724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a390c8-9848-4a5f-9d8a-47c9da11cc23 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:25.084028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:25.085077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:25.085614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:25.086137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:25.087016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:25.087579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:25.089312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:25.096003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 453/922] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:25.102362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:25.140163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:25.214128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8079809-a3e7-474f-8bdd-211fb46584ec None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:25.252137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c327f9-f417-45d6-b24f-da5584167126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:25.252757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c327f9-f417-45d6-b24f-da5584167126 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:25.253032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c327f9-f417-45d6-b24f-da5584167126 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:25.253308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c327f9-f417-45d6-b24f-da5584167126 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:25.253943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c327f9-f417-45d6-b24f-da5584167126 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:25.254276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c327f9-f417-45d6-b24f-da5584167126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:25.255635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c327f9-f417-45d6-b24f-da5584167126 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:25.261384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 470/923] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 22 14:21:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:25.267635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:25.329551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:25.386324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6f9af-3c7a-4dc3-ba05-0aadbcf98c28 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:25.423130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85612ed3-a2f0-455f-bf6d-a58d78762e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:25.423833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85612ed3-a2f0-455f-bf6d-a58d78762e9d None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:25.424126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85612ed3-a2f0-455f-bf6d-a58d78762e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:25.424443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85612ed3-a2f0-455f-bf6d-a58d78762e9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:25.425229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85612ed3-a2f0-455f-bf6d-a58d78762e9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:25.426728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85612ed3-a2f0-455f-bf6d-a58d78762e9d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:25.509198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 454/924] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:21:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:26.529801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd19565-269e-402a-88c5-acf02d4d5bcd None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:26.530728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd19565-269e-402a-88c5-acf02d4d5bcd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:26.531186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd19565-269e-402a-88c5-acf02d4d5bcd None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:26.533138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 471/925] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:26.539170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b31d-7bb0-4ebf-9469-173386a823f2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:26.540103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b31d-7bb0-4ebf-9469-173386a823f2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:26.540657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208b31d-7bb0-4ebf-9469-173386a823f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:26.562706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4208b31d-7bb0-4ebf-9469-173386a823f2 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:26.564443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4208b31d-7bb0-4ebf-9469-173386a823f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:26.650609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 455/926] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:26.708830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe35e5-5aba-4170-8fbe-97da8e648ed7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:26.709163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe35e5-5aba-4170-8fbe-97da8e648ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:26.709383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe35e5-5aba-4170-8fbe-97da8e648ed7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:26.711016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 472/927] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:26.716266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924dbe3-3f6c-4c92-a569-6bd80dc7d1d5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:26.717107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924dbe3-3f6c-4c92-a569-6bd80dc7d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:26.718116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924dbe3-3f6c-4c92-a569-6bd80dc7d1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:26.737715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7924dbe3-3f6c-4c92-a569-6bd80dc7d1d5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:26.738969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7924dbe3-3f6c-4c92-a569-6bd80dc7d1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:26.766289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:26.784891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0939aee-237b-4868-a6a9-67f12ed71238 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:26.784891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0939aee-237b-4868-a6a9-67f12ed71238 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:26.784891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0939aee-237b-4868-a6a9-67f12ed71238 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:26.787444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 473/928] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:26.791528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff818-ba64-4e13-9029-39e926e71cd3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:26.791810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff818-ba64-4e13-9029-39e926e71cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:26.792088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff818-ba64-4e13-9029-39e926e71cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:26.816621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 456/929] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:26.819079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-19eff818-ba64-4e13-9029-39e926e71cd3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:26.820624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-19eff818-ba64-4e13-9029-39e926e71cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:26.897499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 474/930] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:26.944509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924dbe3-3f6c-4c92-a569-6bd80dc7d1d5 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.054458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924dbe3-3f6c-4c92-a569-6bd80dc7d1d5 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.092082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.093237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.093722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.094237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.095076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:27.096742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:27.106959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:27.108471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:27.109449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:27.112210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 457/931] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:27.118962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff818-ba64-4e13-9029-39e926e71cd3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.121267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.157005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:27.166368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:27.243601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff818-ba64-4e13-9029-39e926e71cd3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.246695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a9d7f-f439-47e6-9f1c-eaafc29efa46 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.286806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.287750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.288032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.288310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.288949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:27.289253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:27.290647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:27.292495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.293135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.293415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.293686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.294312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:27.296459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 475/932] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:27.296574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:27.301782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:27.305551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:27.306623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:27.307575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 458/933] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:27.308485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.409068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:27.413900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:27.418548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779da5ea-aa59-41f7-8ff3-820f389c9564 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.430941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983c75-f1eb-47de-b533-86f3cef5c8d4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.457619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1f6b-531d-4a9a-b624-75859297b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.458832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1f6b-531d-4a9a-b624-75859297b81e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.459370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1f6b-531d-4a9a-b624-75859297b81e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.460326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1f6b-531d-4a9a-b624-75859297b81e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.469625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.470274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.470556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.470834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.471478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:27.471780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:27.472588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc1f6b-531d-4a9a-b624-75859297b81e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:27.473192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:27.486961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 459/934] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-95bc1f6b-531d-4a9a-b624-75859297b81e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:27.487168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:27.488290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:27.489164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:27.489827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.489914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 476/935] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:27.489914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1f6b-531d-4a9a-b624-75859297b81e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.610576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f55c55-d53e-4891-9640-59c49e7ab4a1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.632142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1f6b-531d-4a9a-b624-75859297b81e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.662295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.663171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.663557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.663933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.664858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:27.666009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:27.667995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:27.676594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 460/936] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:27.683057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.684424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.685037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.685421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.685687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.686419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:27.686715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:27.688080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:27.696951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 477/937] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:27.703534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.710383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:27.725317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:27.799932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966295b-6d19-448f-9ec4-140daaff0392 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.826765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c7761-4f0e-440a-acba-fac08de66cf0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:27.834671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41363293-81f1-4cbd-aa12-c759c7580c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.835270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41363293-81f1-4cbd-aa12-c759c7580c3d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.835722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41363293-81f1-4cbd-aa12-c759c7580c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.835999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41363293-81f1-4cbd-aa12-c759c7580c3d None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.836621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41363293-81f1-4cbd-aa12-c759c7580c3d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:27.836921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41363293-81f1-4cbd-aa12-c759c7580c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:27.838709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41363293-81f1-4cbd-aa12-c759c7580c3d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:27.844861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 461/938] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:27.845943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f26f7-7183-4e42-9edf-672bf3f6a974 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.846342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f26f7-7183-4e42-9edf-672bf3f6a974 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.846637 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f26f7-7183-4e42-9edf-672bf3f6a974 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.847941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 462/939] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:27.853519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974bb1-b561-4be8-aecc-6a0c53d8ea4c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.853844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974bb1-b561-4be8-aecc-6a0c53d8ea4c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.854152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974bb1-b561-4be8-aecc-6a0c53d8ea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.876138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-76974bb1-b561-4be8-aecc-6a0c53d8ea4c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:27.877796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-76974bb1-b561-4be8-aecc-6a0c53d8ea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:27.878368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:27.879003 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:27.879277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:27.879550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:27.891127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:27.892562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:27.906945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:27.908085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:27.908985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:27.908985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:27.908985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:27.908985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 478/940] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:27.908985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.969070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 463/941] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:27.969773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974bb1-b561-4be8-aecc-6a0c53d8ea4c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:27.981566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:27.998961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:28.041248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74961a35-b3bb-4212-a77b-ff88085cb4e9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.084253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974bb1-b561-4be8-aecc-6a0c53d8ea4c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.092755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.093385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.093683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.094572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.095425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] RBAC: Adding query filter params (interface=public, service_id=a5a9070aff0f435d90bbacdfa4b0372a, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:28.095745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.097620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.110502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 479/942] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/endpoints?service_id=a5a9070aff0f435d90bbacdfa4b0372a&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:28.112073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:28.139921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.140513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.140814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.141111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.141903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:28.142297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.144375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.166061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 464/943] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:28.169134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:28.264654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe691c-7469-4f73-84a5-c85e3aec21c9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.266445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:28.300931 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:28.306985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65ae80-2e59-4f8d-8ece-0d6d0b4eb3ed None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.308958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d48df-76ff-421d-9814-62b572fe0eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.309878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d48df-76ff-421d-9814-62b572fe0eab None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.310985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d48df-76ff-421d-9814-62b572fe0eab None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.311398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d48df-76ff-421d-9814-62b572fe0eab None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.312256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d48df-76ff-421d-9814-62b572fe0eab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.314171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d48df-76ff-421d-9814-62b572fe0eab None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.330510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 480/944] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:21:28 2022] GET /identity/v3/services => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:21:28.332170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d48df-76ff-421d-9814-62b572fe0eab None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:28.351561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.353401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.353944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.354609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.368198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.370831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:28.386666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:28.387738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:28.388735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:28.395156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 465/945] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:21:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:28.395706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:28.484825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d48df-76ff-421d-9814-62b572fe0eab None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.537441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.538083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.538370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.538796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.539460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.540877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.542975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e4e00-e452-4228-a7d5-d84e6cc48ff8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.543528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING keystone.server.flask.common [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 22 14:21:28.579279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:28.585744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108c67-25d2-4390-a159-81205946a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.586392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108c67-25d2-4390-a159-81205946a406 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.586670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108c67-25d2-4390-a159-81205946a406 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.587064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108c67-25d2-4390-a159-81205946a406 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.587766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37108c67-25d2-4390-a159-81205946a406 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:28.588066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37108c67-25d2-4390-a159-81205946a406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.589489 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37108c67-25d2-4390-a159-81205946a406 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.600514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.sql.core [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 14:21:28.600514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 14:21:28.600514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [parameters: {'id': '2033cea7f32748e88589abd33d77ba63', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 14:21:28.600514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81549) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 14:21:28.617509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 466/946] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 22 14:21:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2033cea7f32748e88589abd33d77ba63.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2033cea7f32748e88589abd33d77ba63. Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 14:21:28.621343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 22 14:21:28.622212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application yield resource Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise self.value Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application session.commit() Sep 22 14:21:28.623756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.flush() Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application compat.raise_( Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 14:21:28.625135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 14:21:28.626547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 14:21:28.628320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [parameters: {'id': '2033cea7f32748e88589abd33d77ba63', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:28.630713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:28.638114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2033cea7f32748e88589abd33d77ba63. Sep 22 14:21:28.639757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:28.640273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108c67-25d2-4390-a159-81205946a406 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:28.640349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 481/947] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Sep 22 14:21:28 2022] POST /identity/v3/projects => generated 262 bytes in 304 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:28.643450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:28.710770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:28.746635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108c67-25d2-4390-a159-81205946a406 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.773338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd8c58-7c0a-4d87-8392-88e1401399c2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.785966 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.786902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.787322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.787801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.798942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.800595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.814969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.815655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.815999 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.826842 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:28.827000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:28.828062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:28.829170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:28.829170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:28.829170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:28.829170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 467/948] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:28.829445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.829445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.829606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:28.843240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:28.845023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:28.847703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 482/949] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:28.854002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:28.879403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:28.951071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e339bf-637b-4dbb-b733-f94c92acc0dc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:28.992063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:28.992791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:28.993292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:28.993543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:28.994312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:28.994687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:28.996115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:28.996890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db857d0b-cce5-4566-a1dc-fb33862fe218 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:29.009577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:29.012623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 468/950] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:29.018777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:29.043849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:29.045366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:29.045851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:29.046510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:29.047381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:29.047963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:29.049780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:29.072305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 483/951] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:29.132669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:29.135950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9c36-4b1c-4b50-9085-62390ed66e7e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:29.177391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:29.178074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:29.178354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:29.178625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:29.186867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:29.188384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:29.201692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:29.202803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:29.203794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 469/952] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:29.210958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:29.333371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711d61-ec5a-424b-b9fc-330f29fb2962 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:29.370496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea5ff5-2b81-430a-840a-0e7fff31436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:29.371108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5ff5-2b81-430a-840a-0e7fff31436a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:29.371387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5ff5-2b81-430a-840a-0e7fff31436a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:29.371657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5ff5-2b81-430a-840a-0e7fff31436a None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:29.372357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea5ff5-2b81-430a-840a-0e7fff31436a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:29.373190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea5ff5-2b81-430a-840a-0e7fff31436a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:29.374864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea5ff5-2b81-430a-840a-0e7fff31436a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:29.388258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 484/953] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:29.395049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:29.514783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29d269-e2ba-4e56-8961-599a9c0a2445 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:29.550542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4254f6-ed5c-4a4f-bd55-4d039fe1141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:29.551204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4254f6-ed5c-4a4f-bd55-4d039fe1141d None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:29.551480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4254f6-ed5c-4a4f-bd55-4d039fe1141d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:29.551809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4254f6-ed5c-4a4f-bd55-4d039fe1141d None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/1b136a57b34c46e6b691d2a24e1288f9/roles/8cd79564c7de4789b67106a74a9ae9ff` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:29.554003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4254f6-ed5c-4a4f-bd55-4d039fe1141d None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=1b136a57b34c46e6b691d2a24e1288f9, role_id=8cd79564c7de4789b67106a74a9ae9ff)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:29.555445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4254f6-ed5c-4a4f-bd55-4d039fe1141d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:29.637791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 470/954] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:21:29 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/1b136a57b34c46e6b691d2a24e1288f9/roles/8cd79564c7de4789b67106a74a9ae9ff => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:21:29.828043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd1c34-414f-4b72-9d84-29978ea17b77 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:29.828709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd1c34-414f-4b72-9d84-29978ea17b77 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:29.828709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd1c34-414f-4b72-9d84-29978ea17b77 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:29.830151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 485/955] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:29.835710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdd0da-569e-4932-9f9e-4bb0340edd90 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:29.836298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdd0da-569e-4932-9f9e-4bb0340edd90 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:29.836708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdd0da-569e-4932-9f9e-4bb0340edd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:29.859668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ecbdd0da-569e-4932-9f9e-4bb0340edd90 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:29.860937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ecbdd0da-569e-4932-9f9e-4bb0340edd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:29.877530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:29.934455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 471/956] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:30.205668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd1c34-414f-4b72-9d84-29978ea17b77 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:30.239565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:30.317284 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd1c34-414f-4b72-9d84-29978ea17b77 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:30.353244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f71735-04ed-4f12-b596-f8715e26dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:30.353847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71735-04ed-4f12-b596-f8715e26dd06 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:30.354160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71735-04ed-4f12-b596-f8715e26dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:30.354435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71735-04ed-4f12-b596-f8715e26dd06 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:30.355156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f71735-04ed-4f12-b596-f8715e26dd06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:30.356570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f71735-04ed-4f12-b596-f8715e26dd06 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:30.472948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 486/957] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:21:30 2022] POST /identity/v3/services => generated 242 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:30.662148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a749-d00d-44f2-b406-8f7c83e6a553 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:30.662748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a749-d00d-44f2-b406-8f7c83e6a553 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:30.662748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a749-d00d-44f2-b406-8f7c83e6a553 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:30.664037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 472/958] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:30.670237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6a51-f109-4304-ae2d-39f94e4f53e5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:30.670563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6a51-f109-4304-ae2d-39f94e4f53e5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:30.670909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec6a51-f109-4304-ae2d-39f94e4f53e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:30.692354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f4ec6a51-f109-4304-ae2d-39f94e4f53e5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:30.694352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f4ec6a51-f109-4304-ae2d-39f94e4f53e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:30.770781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 487/959] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:31.047459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95a749-d00d-44f2-b406-8f7c83e6a553 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:31.160850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95a749-d00d-44f2-b406-8f7c83e6a553 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:31.196887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:31.197524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:31.197799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:31.198094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:31.198678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:31.200033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:31.210013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:31.211146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:31.212022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 473/960] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:31.219918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6a51-f109-4304-ae2d-39f94e4f53e5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:31.250489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:31.345113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec6a51-f109-4304-ae2d-39f94e4f53e5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:31.385732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571681f-bcfd-4206-b6e8-669f89ac9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:31.386393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571681f-bcfd-4206-b6e8-669f89ac9db1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:31.386714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571681f-bcfd-4206-b6e8-669f89ac9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:31.386989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571681f-bcfd-4206-b6e8-669f89ac9db1 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:31.387638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571681f-bcfd-4206-b6e8-669f89ac9db1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:31.387941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571681f-bcfd-4206-b6e8-669f89ac9db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:31.389574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571681f-bcfd-4206-b6e8-669f89ac9db1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:31.395685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 488/961] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:31.401338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:31.422502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:31.488036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc49a79-4807-440b-b854-07928cab85b5 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:31.488703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc49a79-4807-440b-b854-07928cab85b5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:31.489184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc49a79-4807-440b-b854-07928cab85b5 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:31.491024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 489/962] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:31.497510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769098-3e8b-4eea-b34d-6c5e4f5e3e31 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:31.498579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769098-3e8b-4eea-b34d-6c5e4f5e3e31 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:31.499178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769098-3e8b-4eea-b34d-6c5e4f5e3e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:31.520402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-55769098-3e8b-4eea-b34d-6c5e4f5e3e31 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:31.521397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ece028-4e0f-4016-be90-ad8656872db1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:31.522189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55769098-3e8b-4eea-b34d-6c5e4f5e3e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:31.566184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:31.566812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:31.568056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:31.568366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:31.569052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:31.569361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:31.570784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:31.580395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 474/963] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:31.586425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:31.618138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 490/964] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:31.675295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:31.698643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cab8f-3d47-4322-bfa1-c969f9bbaa61 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:31.734837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971916a-48e6-4414-b941-fc8541d66f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:31.735908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971916a-48e6-4414-b941-fc8541d66f7e None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:31.736390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971916a-48e6-4414-b941-fc8541d66f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:31.736860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971916a-48e6-4414-b941-fc8541d66f7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:31.737760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971916a-48e6-4414-b941-fc8541d66f7e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:31.739364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971916a-48e6-4414-b941-fc8541d66f7e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:31.826470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 475/965] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:21:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:21:31.918513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769098-3e8b-4eea-b34d-6c5e4f5e3e31 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:31.934581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:32.009377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaed99-3cc4-4415-bdc1-158daddd769c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.010074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaed99-3cc4-4415-bdc1-158daddd769c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.010723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaed99-3cc4-4415-bdc1-158daddd769c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.012534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 476/966] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:32.018511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c644-1fe9-4379-acb4-37829952119e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.019118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c644-1fe9-4379-acb4-37829952119e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.019394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c644-1fe9-4379-acb4-37829952119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.042785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769098-3e8b-4eea-b34d-6c5e4f5e3e31 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:32.043107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1352c644-1fe9-4379-acb4-37829952119e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:32.044321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1352c644-1fe9-4379-acb4-37829952119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:32.102650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:32.103893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.104616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.105091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.106280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:32.108428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:32.124109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 477/967] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:32.173202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.sql.core [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 14:21:32.173202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 14:21:32.173202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [parameters: {'user_id': '5aafe8c42db945348a42f5efe807bf47', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 14:21:32.173202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81549) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 22 14:21:32.181557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 14:21:32.182465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application yield resource Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.rollback() Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.force_reraise() Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise self.value Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application session.commit() Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 22 14:21:32.183491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._prepare_impl() Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.flush() Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._flush(objects) Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application compat.raise_( Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application flush_context.execute() Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rec.execute(self) Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 22 14:21:32.184398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 22 14:21:32.185845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 22 14:21:32.188496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [parameters: {'user_id': '5aafe8c42db945348a42f5efe807bf47', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:32.190548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 22 14:21:32.192545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 22 14:21:32.196291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 22 14:21:32.196291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 22 14:21:32.196291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 22 14:21:32.196291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 22 14:21:32.196291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 22 14:21:32.196291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:32.196291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 491/968] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 22 14:21:31 2022] POST /identity/v3/users => generated 160 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:32.201817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352c644-1fe9-4379-acb4-37829952119e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:32.286356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:32.321891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352c644-1fe9-4379-acb4-37829952119e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:32.360666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:32.361605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.362098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.362523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.370917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:32.373094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:32.385491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:32.386767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 22 14:21:32.387972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:32.391264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 478/969] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:32.397446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:32.408983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:32.478910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:32.519387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e608a8c-613c-4cf3-ae58-74157fbde07d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:32.530963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612e9d-1b7f-4711-af4e-95371dbb58ca None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:32.559449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:32.560678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.561266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.561549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.562293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:32.562669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:32.562917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:32.565042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:32.575122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c76d7-65dc-4e83-a89f-392d637b80d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:32.576138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c76d7-65dc-4e83-a89f-392d637b80d7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.576622 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c76d7-65dc-4e83-a89f-392d637b80d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.576962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c76d7-65dc-4e83-a89f-392d637b80d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.589403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c76d7-65dc-4e83-a89f-392d637b80d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-073c76d7-65dc-4e83-a89f-392d637b80d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:32.597013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:32.598148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:32.599019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:32.604436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 479/970] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 22 14:21:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:32.605595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c76d7-65dc-4e83-a89f-392d637b80d7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:32.618086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 492/971] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 22 14:21:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:32.736133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c76d7-65dc-4e83-a89f-392d637b80d7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:32.780049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564047a-457a-485b-a74c-72f1f038cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:32.780683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564047a-457a-485b-a74c-72f1f038cc08 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.780959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564047a-457a-485b-a74c-72f1f038cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.781230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564047a-457a-485b-a74c-72f1f038cc08 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.781924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564047a-457a-485b-a74c-72f1f038cc08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:32.782260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564047a-457a-485b-a74c-72f1f038cc08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:32.783652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564047a-457a-485b-a74c-72f1f038cc08 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:32.793554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 480/972] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 22 14:21:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:32.799750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:32.802677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689df5f-c3c6-4ef3-b778-c48a50e9846a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.802963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689df5f-c3c6-4ef3-b778-c48a50e9846a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.803231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689df5f-c3c6-4ef3-b778-c48a50e9846a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.804845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 481/973] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:32.811948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070393d-0ff3-48a7-a094-1ed52425f69d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.812250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070393d-0ff3-48a7-a094-1ed52425f69d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.812488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070393d-0ff3-48a7-a094-1ed52425f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.831750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4070393d-0ff3-48a7-a094-1ed52425f69d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:32.832953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4070393d-0ff3-48a7-a094-1ed52425f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:32.887204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:32.924989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 482/974] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:32.941489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314ed6-138e-43b8-911a-4275caa94bf3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:32.971375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:32.980951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:32.981682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:32.982608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:32.982850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:32.994015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:32.995484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:33.011924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:33.012956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:33.015853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:33.015853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:33.015853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:33.015853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 493/975] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:33.019628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070393d-0ff3-48a7-a094-1ed52425f69d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.123720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070393d-0ff3-48a7-a094-1ed52425f69d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:33.158344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:33.158952 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:33.159230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:33.159536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:33.160183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:33.160484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:33.161842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.179349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 483/976] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:33.180542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.213903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.254929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:33.295310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e12a16-28fc-49e5-aecc-b7021569fe83 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:33.321533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c296c-d3a1-413a-8c25-23a242cc57fe None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:33.329936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:33.330585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:33.330861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:33.331127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:33.339013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:33.340433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:33.352517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:33.353672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 22 14:21:33.354987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:33.358520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 494/977] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:33.359366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.361078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:33.361819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:33.362202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:33.362545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:33.363209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:33.364568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:33.373896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:33.375012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:33.379279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 484/978] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:33.380922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.410047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:33.476715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39906-a389-44fd-86c0-6b02b055baad None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:33.485435 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:33.489474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a763971-51a0-4bf3-958a-e04812f44651 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:33.514850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:33.515412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:33.515642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:33.515909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:33.516646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:33.516950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:33.518467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.528939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:33.530048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:33.530457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:33.530833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:33.531603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] RBAC: Adding query filter params (name=compute) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:33.532018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:33.533513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.542779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 495/979] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:33.542943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 485/980] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:33.543822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.544220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.647693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:33.654136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57262f-890c-4a33-a5b0-8955c328d0df None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:33.654333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733bc9-1fd1-4803-ac5c-a6236b02fdab None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:33.690974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:33.691579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:33.691854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:33.692130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:33.692753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:33.693052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:33.693876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ab4b-aabb-46ff-b413-38bf8ea38c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:33.694446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.694569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ab4b-aabb-46ff-b413-38bf8ea38c02 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:33.694824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ab4b-aabb-46ff-b413-38bf8ea38c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:33.695095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807ab4b-aabb-46ff-b413-38bf8ea38c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:33.704933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 486/981] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:33.705784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.735266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:33.777094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807ab4b-aabb-46ff-b413-38bf8ea38c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:33.778779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807ab4b-aabb-46ff-b413-38bf8ea38c02 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.807289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0864-4cd6-4af1-8128-43d5465be474 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:33.845997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:33.846714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:33.847064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:33.847413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:33.848124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] RBAC: Adding query filter params (interface=public, service_id=de7d6b7a7a664370a59f7b5e343585af, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:33.848429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:33.849805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:33.856267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 487/982] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/endpoints?service_id=de7d6b7a7a664370a59f7b5e343585af&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:33.861883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.879738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:33.886540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 496/983] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 14:21:33.892693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ab4b-aabb-46ff-b413-38bf8ea38c02 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:33.963083 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:33.971715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfed76-5e52-49ce-a7da-a5eef5bbd4c5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:34.001777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807ab4b-aabb-46ff-b413-38bf8ea38c02 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:34.005785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e884b4-daf0-4dcf-848e-879cc806a355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:34.006498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e884b4-daf0-4dcf-848e-879cc806a355 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.006782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e884b4-daf0-4dcf-848e-879cc806a355 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.007055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e884b4-daf0-4dcf-848e-879cc806a355 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.007675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e884b4-daf0-4dcf-848e-879cc806a355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:34.009044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e884b4-daf0-4dcf-848e-879cc806a355 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:34.016313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 488/984] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:21:34.039193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceadf5-c617-4b2a-a1d4-74fdc83f5ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:34.039858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceadf5-c617-4b2a-a1d4-74fdc83f5ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.040207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceadf5-c617-4b2a-a1d4-74fdc83f5ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.040552 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceadf5-c617-4b2a-a1d4-74fdc83f5ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.052537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceadf5-c617-4b2a-a1d4-74fdc83f5ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:34.054145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceadf5-c617-4b2a-a1d4-74fdc83f5ea5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0aceadf5-c617-4b2a-a1d4-74fdc83f5ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:34.070911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:34.072144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:34.073346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:34.073346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:34.073346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:34.074251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 497/985] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:34.080830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e884b4-daf0-4dcf-848e-879cc806a355 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:34.197076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e884b4-daf0-4dcf-848e-879cc806a355 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:34.211005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198aca-e1b2-40ef-8141-54f8e0348c12 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.211281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198aca-e1b2-40ef-8141-54f8e0348c12 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.211551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae198aca-e1b2-40ef-8141-54f8e0348c12 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.213111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 498/986] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:34.218467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96892-babe-4f75-ac88-bda821134fe5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.218741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96892-babe-4f75-ac88-bda821134fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.219008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96892-babe-4f75-ac88-bda821134fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.239247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fba96892-babe-4f75-ac88-bda821134fe5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:34.240872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fba96892-babe-4f75-ac88-bda821134fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:34.247371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:34.248643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.249012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.249385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.250570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:34.250976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:34.253193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:34.266247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 489/987] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:34.271924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:34.289934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:34.299829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:34.315344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 499/988] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:34.383521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dea39-59c8-4061-a580-134f813f1e16 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:34.417443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:34.418109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.418392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.418673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.426049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:34.427497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:34.439528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:34.440423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:34.441427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:34.441427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:34.441427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:34.441427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:34.441427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:34.441427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:34.441427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:34.441427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:34.442495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 490/989] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:34.446437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96892-babe-4f75-ac88-bda821134fe5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:34.551527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96892-babe-4f75-ac88-bda821134fe5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:34.585243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:34.585873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.586177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.586455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.587149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:34.587456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:34.588871 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:34.593432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:34.608397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 500/990] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:34.610246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:34.658609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:34.683917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:34.707575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54119dbd-c8ac-41b5-a1d3-40b50b0dbe1a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:34.724632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3166c-16b9-4fb3-9395-af70a9964cee None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:34.744832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:34.745470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.745744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.746033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.746620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:34.748053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:34.756936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:34.757960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:34.759775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 491/991] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:34.764448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:34.765252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:34.765864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.766169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.766440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.767171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] RBAC: Adding query filter params (role.id=8cd79564c7de4789b67106a74a9ae9ff, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=1b136a57b34c46e6b691d2a24e1288f9) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:34.767476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:34.769418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:34.786238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 501/992] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:34 2022] GET /identity/v3/role_assignments?user.id=1b136a57b34c46e6b691d2a24e1288f9&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=8cd79564c7de4789b67106a74a9ae9ff => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:34.880671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5046-0e5b-4e48-9abf-834ecb484109 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:34.919209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:34.919865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:34.920143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:34.920417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:34.921073 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:34.921376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:34.922792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:34.928707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 492/993] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:34.934506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:35.050844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a4ec-9959-4e60-b063-caa1ec693e34 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:35.052453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:35.084736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:35.085343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:35.085622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:35.085892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:35.086550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:35.087267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:35.089138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:35.100017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 502/994] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:35.101868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:35.105643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:35.202525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980beb1-99a6-4215-a8d2-238a21fe117a None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:35.246074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0381e8c-db4f-4d57-9cca-b7a3c5caabd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:35.246724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0381e8c-db4f-4d57-9cca-b7a3c5caabd7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:35.247004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0381e8c-db4f-4d57-9cca-b7a3c5caabd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:35.247275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0381e8c-db4f-4d57-9cca-b7a3c5caabd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:35.248732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0381e8c-db4f-4d57-9cca-b7a3c5caabd7 None admin] RBAC: Adding query filter params (interface=admin, service_id=a5a9070aff0f435d90bbacdfa4b0372a, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:35.248953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0381e8c-db4f-4d57-9cca-b7a3c5caabd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:35.250433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0381e8c-db4f-4d57-9cca-b7a3c5caabd7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:35.256143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 493/995] 10.222.0.16 () {56 vars in 1249 bytes} [Thu Sep 22 14:21:35 2022] GET /identity/v3/endpoints?service_id=a5a9070aff0f435d90bbacdfa4b0372a&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:35.261744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:35.373010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7093-bb09-493c-be41-6e4ce4f5374a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:35.411782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb374ae-a0dc-4965-a486-52e5d91f7678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:35.412392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb374ae-a0dc-4965-a486-52e5d91f7678 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:35.412670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb374ae-a0dc-4965-a486-52e5d91f7678 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:35.412940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb374ae-a0dc-4965-a486-52e5d91f7678 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:35.413542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb374ae-a0dc-4965-a486-52e5d91f7678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:35.414996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb374ae-a0dc-4965-a486-52e5d91f7678 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:35.426072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 503/996] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:21:35 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:21:36.327446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3fe28-c033-4636-8b05-cfb3d370f56c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:36.327985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3fe28-c033-4636-8b05-cfb3d370f56c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:36.327985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3fe28-c033-4636-8b05-cfb3d370f56c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:36.329602 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 494/997] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:36.335281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c8b7-742e-4e42-a442-57a0d3a645cd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:36.335736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c8b7-742e-4e42-a442-57a0d3a645cd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:36.335887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83c8b7-742e-4e42-a442-57a0d3a645cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:36.355564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5b83c8b7-742e-4e42-a442-57a0d3a645cd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:36.356750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5b83c8b7-742e-4e42-a442-57a0d3a645cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:36.383314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:36.431403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 504/998] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:36.699143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3fe28-c033-4636-8b05-cfb3d370f56c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:36.769132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:36.802485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3fe28-c033-4636-8b05-cfb3d370f56c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:36.836800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:36.837425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:36.837703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:36.837971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:36.838733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:36.840080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:36.849003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:36.850723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 22 14:21:36.851605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:36.854358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 495/999] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:36.856144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83c8b7-742e-4e42-a442-57a0d3a645cd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:36.959800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83c8b7-742e-4e42-a442-57a0d3a645cd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:36.993279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a111e-fd5d-4ef4-9162-6de3f95bb48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:36.993888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a111e-fd5d-4ef4-9162-6de3f95bb48f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:36.994189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a111e-fd5d-4ef4-9162-6de3f95bb48f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:36.994462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a111e-fd5d-4ef4-9162-6de3f95bb48f None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:36.995093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a111e-fd5d-4ef4-9162-6de3f95bb48f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:36.995392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a111e-fd5d-4ef4-9162-6de3f95bb48f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:36.996743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a111e-fd5d-4ef4-9162-6de3f95bb48f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:37.006854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 505/1000] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:37.008111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:37.020786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96738d0d-9a1c-4a73-ac88-a5fd77d6f5d0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.021092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96738d0d-9a1c-4a73-ac88-a5fd77d6f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.021334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96738d0d-9a1c-4a73-ac88-a5fd77d6f5d0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.022817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 506/1001] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:37.027571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186fe3-a410-4c07-8889-08ae0bacdad8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.027852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186fe3-a410-4c07-8889-08ae0bacdad8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.028158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186fe3-a410-4c07-8889-08ae0bacdad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.046328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d9186fe3-a410-4c07-8889-08ae0bacdad8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:37.047686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d9186fe3-a410-4c07-8889-08ae0bacdad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:37.070434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:37.114655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace47953-e29e-4d18-81a1-484a4e11320c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:37.134579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 507/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:37.146493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:37.151670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:37.152337 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.152620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.152895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.153631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:37.154555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:37.166705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:37.166705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 496/1003] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 22 14:21:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:37.166901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9186fe3-a410-4c07-8889-08ae0bacdad8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:37.277861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9186fe3-a410-4c07-8889-08ae0bacdad8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:37.312885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a4c7c-e9f9-4bb1-b84d-f40da3693faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:37.313493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a4c7c-e9f9-4bb1-b84d-f40da3693faf None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.313776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a4c7c-e9f9-4bb1-b84d-f40da3693faf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.314080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a4c7c-e9f9-4bb1-b84d-f40da3693faf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.314745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a4c7c-e9f9-4bb1-b84d-f40da3693faf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:37.316110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a4c7c-e9f9-4bb1-b84d-f40da3693faf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:37.395302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:37.449844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 508/1004] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:21:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:21:37.517166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01440411-9a86-4bf9-add9-71b12f35a943 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:37.563504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6d0ef-8981-4b39-8a18-4543776b9da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:37.564185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d0ef-8981-4b39-8a18-4543776b9da0 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.564453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d0ef-8981-4b39-8a18-4543776b9da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.564728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6d0ef-8981-4b39-8a18-4543776b9da0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.565323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6d0ef-8981-4b39-8a18-4543776b9da0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:37.566758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6d0ef-8981-4b39-8a18-4543776b9da0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-cff6d0ef-8981-4b39-8a18-4543776b9da0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:37.577000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:37.582342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:37.583254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 497/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Sep 22 14:21:37 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:37.584879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a4c7c-e9f9-4bb1-b84d-f40da3693faf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:37.601001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:37.633020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccc6fa-4e5a-4412-9d15-cd578556c4a3 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.633353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccc6fa-4e5a-4412-9d15-cd578556c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.633576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccc6fa-4e5a-4412-9d15-cd578556c4a3 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.636452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 498/1006] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:37.642356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555d793-1fac-4395-879a-903619a7d347 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.642638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555d793-1fac-4395-879a-903619a7d347 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.642905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555d793-1fac-4395-879a-903619a7d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.661667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2555d793-1fac-4395-879a-903619a7d347 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:37.662912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2555d793-1fac-4395-879a-903619a7d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:37.706415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a4c7c-e9f9-4bb1-b84d-f40da3693faf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:37.722826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:37.746072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 499/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:37 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:37.749653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:37.750473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.750680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.750954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.751593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] RBAC: Adding query filter params (name=image) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:37.751894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:37.753255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:37.759123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 509/1008] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:37.766103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555d793-1fac-4395-879a-903619a7d347 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:37.869457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555d793-1fac-4395-879a-903619a7d347 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:37.903117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:37.903820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:37.904118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:37.904367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:37.904997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:37.905298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:37.906731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:37.911628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 500/1009] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:38.017476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:38.099875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:38.126898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac141c-75b7-45dd-a4cb-e56f544f243e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:38.161628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:38.162285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:38.162619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:38.162888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:38.163494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:38.164843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:38.174305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:38.175334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:38.178844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 510/1010] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 22 14:21:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:38.181938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:38.241800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:38.293420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93332e-b8de-4bcd-8795-e229c17c70d7 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:38.329116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:38.329739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:38.330039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:38.330315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:38.330951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:38.331248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:38.332615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:38.338278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 501/1011] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:38.344288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:38.445360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672b6c-b6d6-4d15-8f39-201486b7353c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:38.483350 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873f083-456f-47e6-9868-c31b0f3419fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:38.483998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873f083-456f-47e6-9868-c31b0f3419fd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:38.484236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873f083-456f-47e6-9868-c31b0f3419fd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:38.484489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873f083-456f-47e6-9868-c31b0f3419fd None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:38.485125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873f083-456f-47e6-9868-c31b0f3419fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:38.485425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873f083-456f-47e6-9868-c31b0f3419fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:38.486813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873f083-456f-47e6-9868-c31b0f3419fd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:38.496727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 511/1012] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 22 14:21:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:38.498309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:38.601664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3678c-a11b-4ba8-9b68-17cb8da3fd62 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:38.616322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:38.636122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce046a6-9a07-4de2-a2da-8e2c05cbd136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:38.636734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce046a6-9a07-4de2-a2da-8e2c05cbd136 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:38.637010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce046a6-9a07-4de2-a2da-8e2c05cbd136 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:38.637284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce046a6-9a07-4de2-a2da-8e2c05cbd136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:38.638538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce046a6-9a07-4de2-a2da-8e2c05cbd136 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:38.639894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce046a6-9a07-4de2-a2da-8e2c05cbd136 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:38.729866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 502/1013] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:21:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:39.772410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3205163-2060-4898-8bb0-a0a7e2829fba None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:39.773043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3205163-2060-4898-8bb0-a0a7e2829fba None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:39.773043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3205163-2060-4898-8bb0-a0a7e2829fba None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:39.774445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 512/1014] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:39.779518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c112d4-24ea-49a6-a8a1-9acaa37d31e8 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:39.779974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c112d4-24ea-49a6-a8a1-9acaa37d31e8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:39.780212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c112d4-24ea-49a6-a8a1-9acaa37d31e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:39.798364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c4c112d4-24ea-49a6-a8a1-9acaa37d31e8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:39.799552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c4c112d4-24ea-49a6-a8a1-9acaa37d31e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:39.875478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 503/1015] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:39 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:40.108012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86b63-5680-42d8-83ef-3e0f231333b1 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:40.108341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86b63-5680-42d8-83ef-3e0f231333b1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:40.108566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86b63-5680-42d8-83ef-3e0f231333b1 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:40.110000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 513/1016] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:40.115128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723587d-de99-44f8-a4a6-ec28924100f0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:40.115420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723587d-de99-44f8-a4a6-ec28924100f0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:40.115694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723587d-de99-44f8-a4a6-ec28924100f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:40.134439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f723587d-de99-44f8-a4a6-ec28924100f0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:40.135649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f723587d-de99-44f8-a4a6-ec28924100f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:40.141787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac86b63-5680-42d8-83ef-3e0f231333b1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:40.144641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:40.213804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 504/1017] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:40 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:40.255456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac86b63-5680-42d8-83ef-3e0f231333b1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:40.290607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8cd7d-b60b-4138-b39e-daaac2e5995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:40.291228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8cd7d-b60b-4138-b39e-daaac2e5995a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:40.291505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8cd7d-b60b-4138-b39e-daaac2e5995a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:40.291775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8cd7d-b60b-4138-b39e-daaac2e5995a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:40.303459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8cd7d-b60b-4138-b39e-daaac2e5995a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-22d8cd7d-b60b-4138-b39e-daaac2e5995a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:40.308363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:40.309391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:40.310595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 514/1018] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 22 14:21:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:40.315478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723587d-de99-44f8-a4a6-ec28924100f0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:40.347076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:40.416510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723587d-de99-44f8-a4a6-ec28924100f0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:40.451415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:40.452064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:40.452342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:40.452610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:40.453272 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:40.453570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:40.454960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:40.468013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 505/1019] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 22 14:21:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:40.469366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8cd7d-b60b-4138-b39e-daaac2e5995a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:40.498605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:40.535701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:40.580745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8cd7d-b60b-4138-b39e-daaac2e5995a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:40.604047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:40.613375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db62db-2be2-4494-bd68-eb5f2b50b2f1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:40.623456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:40.623885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:40.624166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:40.624439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:40.636128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:40.637641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:40.649934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd30fd-cd88-4699-b89b-9f636ec4d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:40.650589 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd30fd-cd88-4699-b89b-9f636ec4d318 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:40.650867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd30fd-cd88-4699-b89b-9f636ec4d318 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:40.651140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd30fd-cd88-4699-b89b-9f636ec4d318 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:40.651825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd30fd-cd88-4699-b89b-9f636ec4d318 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:40.653186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd30fd-cd88-4699-b89b-9f636ec4d318 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:40.654493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:40.655456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:40.656378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:40.656378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:40.656378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:40.660405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 515/1020] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:40.661226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:40.734213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 506/1021] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:21:40 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:21:40.770797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb020-7483-4d67-9212-c011e08a896b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:40.787872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:40.827300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa314-1cc7-48b0-93bf-a61723d1a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:40.828945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa314-1cc7-48b0-93bf-a61723d1a83a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:40.829317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa314-1cc7-48b0-93bf-a61723d1a83a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:40.829672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa314-1cc7-48b0-93bf-a61723d1a83a None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:40.830710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa314-1cc7-48b0-93bf-a61723d1a83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:40.831079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa314-1cc7-48b0-93bf-a61723d1a83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:40.833164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa314-1cc7-48b0-93bf-a61723d1a83a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:40.853739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 516/1022] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:40.855328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd30fd-cd88-4699-b89b-9f636ec4d318 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:40.972800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd30fd-cd88-4699-b89b-9f636ec4d318 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:41.009168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:41.010161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.010459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.010814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.018130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187ef8-1a89-4766-928c-cd94b7df7f19 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.018469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187ef8-1a89-4766-928c-cd94b7df7f19 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.018688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b187ef8-1a89-4766-928c-cd94b7df7f19 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.019139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:41.020161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 517/1023] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:41.020652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:41.025278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c73e-a31d-428d-9d9e-8d7b55ed7d18 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.025566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c73e-a31d-428d-9d9e-8d7b55ed7d18 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.025843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c73e-a31d-428d-9d9e-8d7b55ed7d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:41.032775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:41.033791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:41.034834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 507/1024] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:21:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:41.039576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:41.048199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6571c73e-a31d-428d-9d9e-8d7b55ed7d18 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:41.049864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6571c73e-a31d-428d-9d9e-8d7b55ed7d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:41.056316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:41.121248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 518/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:41.144835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41103032-b96e-4339-9082-3e188f3f6325 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:41.180039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:41.180643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.180920 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.181191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.181910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:41.182249 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:41.183654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:41.201587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 508/1026] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:21:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:41.207214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571c73e-a31d-428d-9d9e-8d7b55ed7d18 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:41.309347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:41.312873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571c73e-a31d-428d-9d9e-8d7b55ed7d18 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:41.346670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858acd4-c8b4-4fb7-be43-e29fc303710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:41.347277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858acd4-c8b4-4fb7-be43-e29fc303710e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.347550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858acd4-c8b4-4fb7-be43-e29fc303710e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.347819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858acd4-c8b4-4fb7-be43-e29fc303710e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.401412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:41.421500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858acd4-c8b4-4fb7-be43-e29fc303710e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:41.423287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858acd4-c8b4-4fb7-be43-e29fc303710e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:41.478183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:41.513418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f2dc1-7a0b-4c37-bc24-7af6382d69f4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:41.531104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:41.535131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 519/1027] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:21:41.540785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858acd4-c8b4-4fb7-be43-e29fc303710e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:41.558337 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac7732-0fb2-4e65-a711-0f8a96d11e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:41.558976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac7732-0fb2-4e65-a711-0f8a96d11e78 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.559315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac7732-0fb2-4e65-a711-0f8a96d11e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.559691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac7732-0fb2-4e65-a711-0f8a96d11e78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.561416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac7732-0fb2-4e65-a711-0f8a96d11e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:41.562904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac7732-0fb2-4e65-a711-0f8a96d11e78 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:41.564648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 509/1028] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:41.570120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac7732-0fb2-4e65-a711-0f8a96d11e78 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:41.649625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858acd4-c8b4-4fb7-be43-e29fc303710e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:41.679981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac7732-0fb2-4e65-a711-0f8a96d11e78 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:41.691128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:41.691884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.692164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.692434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.704303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:41.705857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:41.717806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef722-34d2-4e1e-8c21-adc411b80238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:41.718443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef722-34d2-4e1e-8c21-adc411b80238 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.718719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef722-34d2-4e1e-8c21-adc411b80238 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.718986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ef722-34d2-4e1e-8c21-adc411b80238 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.719623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ef722-34d2-4e1e-8c21-adc411b80238 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:41.721034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ef722-34d2-4e1e-8c21-adc411b80238 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:41.722471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:41.723411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:41.724333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:41.724333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:41.724333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:41.724333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 520/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:41.729734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:41.734793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:41.786358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:41.831998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba177-4559-4c3d-b692-0ffd1644c51c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:41.850660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 510/1030] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:21:41 2022] POST /identity/v3/projects => generated 311 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:21:41.867327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:41.867968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:41.868253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:41.868593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:41.869208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:41.869929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:41.875968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:41.886937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 521/1031] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:41.893480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef722-34d2-4e1e-8c21-adc411b80238 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:42.011611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ef722-34d2-4e1e-8c21-adc411b80238 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:42.052662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:42.054343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:42.054343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:42.054343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:42.062126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:42.063778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:42.075392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:42.076408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:42.077719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 511/1032] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:42.084405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:42.191432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d358ad-02fd-4681-8c1f-798c487148a5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:42.205203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:42.233085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63348eec-b69c-4ad4-890a-479ea8ae60ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:42.233707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348eec-b69c-4ad4-890a-479ea8ae60ad None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:42.234009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348eec-b69c-4ad4-890a-479ea8ae60ad None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:42.234294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348eec-b69c-4ad4-890a-479ea8ae60ad None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:42.234983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63348eec-b69c-4ad4-890a-479ea8ae60ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:42.235287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63348eec-b69c-4ad4-890a-479ea8ae60ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:42.236706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63348eec-b69c-4ad4-890a-479ea8ae60ad None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:42.258277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 522/1033] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:42.259174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:42.310939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:42.361017 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059364-7033-4bfb-9edd-07a6f9d49581 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:42.396099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39988-e8e5-4eb7-aed1-4ee7612daf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:42.396707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39988-e8e5-4eb7-aed1-4ee7612daf98 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:42.396985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39988-e8e5-4eb7-aed1-4ee7612daf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:42.397259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39988-e8e5-4eb7-aed1-4ee7612daf98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:42.397997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39988-e8e5-4eb7-aed1-4ee7612daf98 None admin] RBAC: Adding query filter params (role.id=8cd79564c7de4789b67106a74a9ae9ff, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=6bc75cc7beb54ef2abd4876b2b35675e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:42.398321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39988-e8e5-4eb7-aed1-4ee7612daf98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:42.399766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39988-e8e5-4eb7-aed1-4ee7612daf98 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:42.412683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 512/1034] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:42 2022] GET /identity/v3/role_assignments?user.id=6bc75cc7beb54ef2abd4876b2b35675e&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=8cd79564c7de4789b67106a74a9ae9ff => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:43.038396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1382a-232e-4391-a150-a2081d1a682b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:43.038984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1382a-232e-4391-a150-a2081d1a682b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:43.038984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1382a-232e-4391-a150-a2081d1a682b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:43.040470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 523/1035] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:43.047652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6446-fea5-486e-a522-82c99eb6aee1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:43.048202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6446-fea5-486e-a522-82c99eb6aee1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:43.048202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6446-fea5-486e-a522-82c99eb6aee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:43.068536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-990b6446-fea5-486e-a522-82c99eb6aee1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:43.069793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-990b6446-fea5-486e-a522-82c99eb6aee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:43.145279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 513/1036] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:43.445321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1382a-232e-4391-a150-a2081d1a682b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:43.554110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1382a-232e-4391-a150-a2081d1a682b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:43.589423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:43.590095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:43.590388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:43.590671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] PATH_INFO: `/v3/services/image` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:43.592463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:43.593824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:43.603398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:43.604526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:43.606135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 524/1037] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Sep 22 14:21:43 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:43.611696 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6446-fea5-486e-a522-82c99eb6aee1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:43.661785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:43.723758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6446-fea5-486e-a522-82c99eb6aee1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:43.766884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:43.767537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:43.767819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:43.768092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:43.768741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] RBAC: Adding query filter params (name=image) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:43.770888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:43.770888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:43.775778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 514/1038] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:43.782601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:43.819353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:43.886587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e0f4a-61a3-46f5-aa42-4386f1df2d7d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:43.922873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:43.923488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:43.923769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:43.924041 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:43.924676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] RBAC: Adding query filter params (type=image) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:43.925000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:43.926395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:43.931549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 525/1039] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:43.938336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:44.050475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e997-046c-49cc-b473-4117bf2cb40b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:44.060731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:44.089531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19766795-4e24-4082-835c-436fda82bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:44.090184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19766795-4e24-4082-835c-436fda82bd41 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:44.090465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19766795-4e24-4082-835c-436fda82bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:44.090836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19766795-4e24-4082-835c-436fda82bd41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:44.092624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19766795-4e24-4082-835c-436fda82bd41 None admin] RBAC: Adding query filter params (interface=public, service_id=30979beed53d4928a1d2d7cff3d412c8, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:44.092936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19766795-4e24-4082-835c-436fda82bd41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:44.094332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19766795-4e24-4082-835c-436fda82bd41 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:44.105322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 515/1040] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 22 14:21:43 2022] GET /identity/v3/endpoints?service_id=30979beed53d4928a1d2d7cff3d412c8&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:44.106683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:44.120445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb49bf-13bc-4340-a2c3-d19f553a1f34 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:44.120731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb49bf-13bc-4340-a2c3-d19f553a1f34 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:44.121032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb49bf-13bc-4340-a2c3-d19f553a1f34 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:44.122707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 516/1041] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:44.127741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00cf9-5aed-4d40-ab43-6a762fd0ef9e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:44.128028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00cf9-5aed-4d40-ab43-6a762fd0ef9e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:44.128299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00cf9-5aed-4d40-ab43-6a762fd0ef9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:44.147494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5db00cf9-5aed-4d40-ab43-6a762fd0ef9e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:44.148692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5db00cf9-5aed-4d40-ab43-6a762fd0ef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:44.210883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:44.214329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50671d-82fa-4749-a788-5bf3bc384775 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:44.221029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 517/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:44.264559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fea78f-4eaa-4fb7-9e38-1c42a1a4ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:44.265174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea78f-4eaa-4fb7-9e38-1c42a1a4ab37 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:44.265455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea78f-4eaa-4fb7-9e38-1c42a1a4ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:44.265728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea78f-4eaa-4fb7-9e38-1c42a1a4ab37 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:44.266365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fea78f-4eaa-4fb7-9e38-1c42a1a4ab37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:44.267732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fea78f-4eaa-4fb7-9e38-1c42a1a4ab37 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:44.274583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 526/1043] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:21:44 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:21:44.492691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db00cf9-5aed-4d40-ab43-6a762fd0ef9e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:44.585049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64bb0-52af-4d75-bbad-e790cdc7c857 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:44.585408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64bb0-52af-4d75-bbad-e790cdc7c857 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:44.585589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba64bb0-52af-4d75-bbad-e790cdc7c857 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:44.587085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 527/1044] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:44.592280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b09e0-916d-4e3a-b3d3-55125b4609c6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:44.592566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b09e0-916d-4e3a-b3d3-55125b4609c6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:44.592838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b09e0-916d-4e3a-b3d3-55125b4609c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:44.608937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db00cf9-5aed-4d40-ab43-6a762fd0ef9e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:44.610529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:44.611907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-978b09e0-916d-4e3a-b3d3-55125b4609c6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:44.613105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-978b09e0-916d-4e3a-b3d3-55125b4609c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:44.645318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a035a8-3614-4184-8bc5-a01b6b785509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:44.645995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a035a8-3614-4184-8bc5-a01b6b785509 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:44.646449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a035a8-3614-4184-8bc5-a01b6b785509 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:44.647458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a035a8-3614-4184-8bc5-a01b6b785509 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:44.648588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a035a8-3614-4184-8bc5-a01b6b785509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:44.650222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a035a8-3614-4184-8bc5-a01b6b785509 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:44.651841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 518/1045] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:44.658016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a035a8-3614-4184-8bc5-a01b6b785509 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:44.688852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 528/1046] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:44.771344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a035a8-3614-4184-8bc5-a01b6b785509 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:44.807927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef8a4-904d-4b13-94c8-e81f6d37aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:44.808535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef8a4-904d-4b13-94c8-e81f6d37aa4f None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:44.808811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef8a4-904d-4b13-94c8-e81f6d37aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:44.809077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef8a4-904d-4b13-94c8-e81f6d37aa4f None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:44.809890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef8a4-904d-4b13-94c8-e81f6d37aa4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:44.811438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef8a4-904d-4b13-94c8-e81f6d37aa4f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:44.928121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 519/1047] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:21:44 2022] POST /identity/v3/users => generated 285 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:21:44.961889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b09e0-916d-4e3a-b3d3-55125b4609c6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:45.069625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:45.078360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b09e0-916d-4e3a-b3d3-55125b4609c6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:45.115038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea255157-48c1-41d5-b048-fde4e7acd4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:45.115690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255157-48c1-41d5-b048-fde4e7acd4cb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:45.115928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255157-48c1-41d5-b048-fde4e7acd4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:45.116183 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255157-48c1-41d5-b048-fde4e7acd4cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:45.127143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea255157-48c1-41d5-b048-fde4e7acd4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ea255157-48c1-41d5-b048-fde4e7acd4cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:45.131937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:45.132898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:45.133767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 529/1048] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 22 14:21:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:45.140348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef8a4-904d-4b13-94c8-e81f6d37aa4f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:45.171469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:45.257795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef8a4-904d-4b13-94c8-e81f6d37aa4f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:45.293485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:45.294716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:45.294995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:45.295281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:45.295927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:45.296225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:45.297585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:45.306108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 520/1049] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 22 14:21:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:45.312114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea255157-48c1-41d5-b048-fde4e7acd4cb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:45.417578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea255157-48c1-41d5-b048-fde4e7acd4cb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:45.451977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:45.452605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:45.452885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:45.453156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:45.464000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:45.465442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:45.480833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:45.481888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:45.483134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:45.483134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:45.483134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:45.486072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 530/1050] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:45.487921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:45.585067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:45.598422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f135b5-585e-4e2e-b847-88ed703de1c4 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:45.635224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:45.635848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:45.636126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:45.636399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:45.637047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:45.637346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:45.639832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:45.658905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 521/1051] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:45.660809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:45.674179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:45.771221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c104f7-e7d0-4662-9e7f-81f944e3a674 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:45.804842 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:45.805466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:45.805744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:45.806042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:45.814622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:45.816048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:45.827909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:45.828874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:45.829856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:45.833822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 531/1052] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:21:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:45.835329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:45.941475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6087e-f6b8-4ac8-a024-3d678f20350d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:45.978166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:45.978775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:45.979048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:45.979315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:45.980042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:45.980548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:45.983007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:46.009490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 522/1053] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:21:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:46.011231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:46.080056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:46.116497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6812d7-7b12-46d7-ae56-77975e87f082 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:46.150679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:46.151310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:46.151589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:46.151862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:46.163397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:46.164850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:46.180071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:46.181259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:46.182670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:46.182670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:46.182670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:46.186058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 532/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:46.188217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:46.197963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:46.297145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1746ef-f51a-42d8-8382-ffe16fd00f7c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:46.331629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ded0b1-d528-4fbc-86f6-0006a12f373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:46.332236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ded0b1-d528-4fbc-86f6-0006a12f373a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:46.332510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ded0b1-d528-4fbc-86f6-0006a12f373a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:46.332782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ded0b1-d528-4fbc-86f6-0006a12f373a None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:46.333419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ded0b1-d528-4fbc-86f6-0006a12f373a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:46.333717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ded0b1-d528-4fbc-86f6-0006a12f373a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:46.335146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ded0b1-d528-4fbc-86f6-0006a12f373a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:46.346789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 523/1055] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:46.355212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:46.465403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe83d9-7db9-4989-a3ab-4eab50dbf0d4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:46.493679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:46.503481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7d30-9bce-4acd-9096-e8b39a06514b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:46.506600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7d30-9bce-4acd-9096-e8b39a06514b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:46.506600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7d30-9bce-4acd-9096-e8b39a06514b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:46.506600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 524/1056] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:46.510567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c642f-3f4a-4c55-8edd-a23a3cd2c6d1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:46.510893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c642f-3f4a-4c55-8edd-a23a3cd2c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:46.511129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c642f-3f4a-4c55-8edd-a23a3cd2c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:46.512929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:46.513736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:46.514000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:46.514280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:46.521127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:46.522595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:46.529742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3c7c642f-3f4a-4c55-8edd-a23a3cd2c6d1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:46.530990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3c7c642f-3f4a-4c55-8edd-a23a3cd2c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:46.535077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:46.536037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:46.536986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:46.536986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:46.536986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:46.536986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:46.536986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:46.536986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:46.536986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:46.536986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:46.544751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 533/1057] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:46.545834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:46.596397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:46.606016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 525/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:46.655956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dd8c5-82d4-4930-9aab-8454ded71c41 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:46.691541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:46.692146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:46.692423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:46.692691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:46.693381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:46.693682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:46.695254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:46.712570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 534/1059] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:46.714171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c642f-3f4a-4c55-8edd-a23a3cd2c6d1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:46.815577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c642f-3f4a-4c55-8edd-a23a3cd2c6d1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:46.850947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69d89-62e4-4a6d-ba9a-34299b478cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:46.851610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69d89-62e4-4a6d-ba9a-34299b478cc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:46.851886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69d89-62e4-4a6d-ba9a-34299b478cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:46.852156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c69d89-62e4-4a6d-ba9a-34299b478cc0 None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/6bc75cc7beb54ef2abd4876b2b35675e/roles/8cd79564c7de4789b67106a74a9ae9ff` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:46.854306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69d89-62e4-4a6d-ba9a-34299b478cc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=6bc75cc7beb54ef2abd4876b2b35675e, role_id=8cd79564c7de4789b67106a74a9ae9ff)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:46.855731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c69d89-62e4-4a6d-ba9a-34299b478cc0 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:46.871992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:46.912494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:46.942961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 526/1060] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:21:46 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/6bc75cc7beb54ef2abd4876b2b35675e/roles/8cd79564c7de4789b67106a74a9ae9ff => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:21:46.979983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58d16b-0956-4997-a212-062c8e934683 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:47.018444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:47.019094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:47.019375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:47.019656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] PATH_INFO: `/v3/services/image` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:47.020257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:47.021648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:47.032310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:47.033405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:47.039512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 535/1061] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Sep 22 14:21:46 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:47.040434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69d89-62e4-4a6d-ba9a-34299b478cc0 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:47.105569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:47.163270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c69d89-62e4-4a6d-ba9a-34299b478cc0 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:47.201192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37c81f-f4cd-47eb-bdd0-20733fae4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:47.201824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c81f-f4cd-47eb-bdd0-20733fae4766 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:47.202103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c81f-f4cd-47eb-bdd0-20733fae4766 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:47.202362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37c81f-f4cd-47eb-bdd0-20733fae4766 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:47.203003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c81f-f4cd-47eb-bdd0-20733fae4766 None admin] RBAC: Adding query filter params (name=image) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:47.203298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c81f-f4cd-47eb-bdd0-20733fae4766 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:47.204731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37c81f-f4cd-47eb-bdd0-20733fae4766 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:47.215283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 527/1062] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:47.216562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:47.249620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583511-c3ff-4844-9b5b-d8815c1f57ac None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:47.249910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583511-c3ff-4844-9b5b-d8815c1f57ac None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:47.250223 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583511-c3ff-4844-9b5b-d8815c1f57ac None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:47.251702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 528/1063] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:47.256685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5cc47-9b7a-4392-8c0d-3752b5052058 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:47.256972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5cc47-9b7a-4392-8c0d-3752b5052058 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:47.257246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5cc47-9b7a-4392-8c0d-3752b5052058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:47.279521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-57a5cc47-9b7a-4392-8c0d-3752b5052058 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:47.280916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-57a5cc47-9b7a-4392-8c0d-3752b5052058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:47.339450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cc6b4-1fdd-4d4f-a521-8506175abf0b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:47.343240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:47.364918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 529/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:47.379961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:47.380968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:47.381670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:47.382247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:47.383325 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] RBAC: Adding query filter params (type=image) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:47.383800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:47.385532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:47.393096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 536/1065] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:47.398698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5cc47-9b7a-4392-8c0d-3752b5052058 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:47.452857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:47.505162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5cc47-9b7a-4392-8c0d-3752b5052058 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:47.540247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0a3d3-93af-405a-ae5d-51edf5f8d8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:47.540890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a3d3-93af-405a-ae5d-51edf5f8d8a5 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:47.541172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a3d3-93af-405a-ae5d-51edf5f8d8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:47.541445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a3d3-93af-405a-ae5d-51edf5f8d8a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:47.542144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0a3d3-93af-405a-ae5d-51edf5f8d8a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:47.543544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0a3d3-93af-405a-ae5d-51edf5f8d8a5 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:47.630099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 530/1066] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:21:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:21:47.635550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:47.753545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870db4d-1ac9-4583-8f53-1843a312cc2f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:47.798345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d706c2-3d7f-4728-b0c0-508988435318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:47.799046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d706c2-3d7f-4728-b0c0-508988435318 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:47.799327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d706c2-3d7f-4728-b0c0-508988435318 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:47.799596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d706c2-3d7f-4728-b0c0-508988435318 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:47.811926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d706c2-3d7f-4728-b0c0-508988435318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-89d706c2-3d7f-4728-b0c0-508988435318 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:47.816875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:47.817808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:47.818732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 537/1067] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:47.825519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0a3d3-93af-405a-ae5d-51edf5f8d8a5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:47.933872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0a3d3-93af-405a-ae5d-51edf5f8d8a5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:47.941578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:47.969037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:47.969647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:47.969923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:47.970235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:47.970901 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:47.971199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:47.972679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:47.986117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 531/1068] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:47.989124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d706c2-3d7f-4728-b0c0-508988435318 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:48.015667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:48.092366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d706c2-3d7f-4728-b0c0-508988435318 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:48.126229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026e5a4-00e2-42ca-bda3-8c9cbc9be868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:48.126857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026e5a4-00e2-42ca-bda3-8c9cbc9be868 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:48.127132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026e5a4-00e2-42ca-bda3-8c9cbc9be868 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:48.127399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026e5a4-00e2-42ca-bda3-8c9cbc9be868 None admin] PATH_INFO: `/v3/users/1e807e93189c4e9b87c304b8851b5074` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:48.141601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026e5a4-00e2-42ca-bda3-8c9cbc9be868 None admin] RBAC: Authorizing `identity:get_user(user_id=1e807e93189c4e9b87c304b8851b5074)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:48.143062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026e5a4-00e2-42ca-bda3-8c9cbc9be868 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:48.149402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 538/1069] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:21:47 2022] GET /identity/v3/users/1e807e93189c4e9b87c304b8851b5074 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:48.151102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:48.258691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d40e26-90a4-456f-b7cf-86a5af623597 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:48.295229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc16931-a1b4-4275-a762-055cd99e1dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:48.295841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc16931-a1b4-4275-a762-055cd99e1dae None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:48.296117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc16931-a1b4-4275-a762-055cd99e1dae None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:48.296385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc16931-a1b4-4275-a762-055cd99e1dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:48.335949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:48.369596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc16931-a1b4-4275-a762-055cd99e1dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:48.371068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc16931-a1b4-4275-a762-055cd99e1dae None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:48.472569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 532/1070] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:21:48.478648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026e5a4-00e2-42ca-bda3-8c9cbc9be868 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:48.561293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:48.580673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026e5a4-00e2-42ca-bda3-8c9cbc9be868 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:48.617221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a1010-7828-48e0-bf85-adea7d87dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:48.617846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1010-7828-48e0-bf85-adea7d87dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:48.618162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1010-7828-48e0-bf85-adea7d87dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:48.618436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1010-7828-48e0-bf85-adea7d87dcc9 None admin] PATH_INFO: `/v3/projects/c4fb80fb49a24588af033759a7b508dd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:48.619552 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1010-7828-48e0-bf85-adea7d87dcc9 None admin] RBAC: Authorizing `identity:get_project(project_id=c4fb80fb49a24588af033759a7b508dd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:48.620963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1010-7828-48e0-bf85-adea7d87dcc9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:48.622891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 539/1071] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:21:48 2022] GET /identity/v3/projects/c4fb80fb49a24588af033759a7b508dd => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:48.628835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc16931-a1b4-4275-a762-055cd99e1dae None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:48.695909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:48.733007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc16931-a1b4-4275-a762-055cd99e1dae None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:48.768433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f12fc6-182e-47b9-8414-7ed085e00e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:48.769034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f12fc6-182e-47b9-8414-7ed085e00e62 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:48.769310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f12fc6-182e-47b9-8414-7ed085e00e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:48.769579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f12fc6-182e-47b9-8414-7ed085e00e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:48.770327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f12fc6-182e-47b9-8414-7ed085e00e62 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=c4fb80fb49a24588af033759a7b508dd, user.id=1e807e93189c4e9b87c304b8851b5074) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:48.770628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f12fc6-182e-47b9-8414-7ed085e00e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:48.772052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f12fc6-182e-47b9-8414-7ed085e00e62 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:48.777580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 533/1072] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:48 2022] GET /identity/v3/role_assignments?user.id=1e807e93189c4e9b87c304b8851b5074&scope.project.id=c4fb80fb49a24588af033759a7b508dd&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:49.185497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb30726-3035-467a-812d-84da85f84d9f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:49.185884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb30726-3035-467a-812d-84da85f84d9f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:49.186163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb30726-3035-467a-812d-84da85f84d9f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:49.187647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 540/1073] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:49.192915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6edc97-a9a4-4506-9223-5a4f6c696018 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:49.193402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6edc97-a9a4-4506-9223-5a4f6c696018 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:49.193698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6edc97-a9a4-4506-9223-5a4f6c696018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:49.212055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3b6edc97-a9a4-4506-9223-5a4f6c696018 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:49.213258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3b6edc97-a9a4-4506-9223-5a4f6c696018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:49.288507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 534/1074] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:49.561038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb30726-3035-467a-812d-84da85f84d9f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:49.667992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb30726-3035-467a-812d-84da85f84d9f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:49.703206 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3995ddd-71e4-4fc4-b37f-b28e52aef722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:49.703836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3995ddd-71e4-4fc4-b37f-b28e52aef722 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:49.704115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3995ddd-71e4-4fc4-b37f-b28e52aef722 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:49.704385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3995ddd-71e4-4fc4-b37f-b28e52aef722 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:49.714514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3995ddd-71e4-4fc4-b37f-b28e52aef722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e3995ddd-71e4-4fc4-b37f-b28e52aef722 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:49.720184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:49.721162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 22 14:21:49.722543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:49.726382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 541/1075] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 22 14:21:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:49.727672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6edc97-a9a4-4506-9223-5a4f6c696018 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:49.794904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:49.834720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6edc97-a9a4-4506-9223-5a4f6c696018 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:49.860744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eadf9d-fa64-426d-aedc-ad7efdc0ef95 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:49.861134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eadf9d-fa64-426d-aedc-ad7efdc0ef95 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:49.861501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eadf9d-fa64-426d-aedc-ad7efdc0ef95 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:49.863509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 542/1076] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:49.868605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898d6d1-ae0b-411a-80fa-cd82bb6e8038 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:49.868882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898d6d1-ae0b-411a-80fa-cd82bb6e8038 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:49.869154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898d6d1-ae0b-411a-80fa-cd82bb6e8038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:49.877769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:49.878421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:49.878702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:49.878978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:49.879646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:49.879950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:49.881346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:49.890101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b898d6d1-ae0b-411a-80fa-cd82bb6e8038 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:49.890479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 535/1077] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 22 14:21:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:49.891719 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b898d6d1-ae0b-411a-80fa-cd82bb6e8038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:49.893890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:49.895965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:49.962519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 543/1078] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:50.006448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88f31d-71d8-4930-b9af-4a4bd39021e3 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:50.031593 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:50.046241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:50.046888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.047167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.047468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.058304 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:50.060194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:50.074219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:50.075753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:50.076685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:50.076685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:50.076685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:50.077418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 536/1079] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:50.081934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898d6d1-ae0b-411a-80fa-cd82bb6e8038 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:50.208965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898d6d1-ae0b-411a-80fa-cd82bb6e8038 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:50.233861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:50.257075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:50.257735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.258035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.258604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.258963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:50.259260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:50.260668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:50.269360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:50.280261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 544/1080] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:50.281302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:50.347782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653ff72-a2fa-45c5-a2a6-32b95067a88f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:50.383750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9697922-0e08-4884-956a-84f50b13eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:50.384352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9697922-0e08-4884-956a-84f50b13eac2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.384627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9697922-0e08-4884-956a-84f50b13eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.384893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9697922-0e08-4884-956a-84f50b13eac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.388580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5dfb2-d9e4-4bc5-9f7c-d2631cc783e2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:50.423517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:50.424152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.424428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.424699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.432776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:50.434781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:50.436657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:21:50.447150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:50.452544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:50.453499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 545/1081] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 22 14:21:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:50.454919 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:50.465273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9697922-0e08-4884-956a-84f50b13eac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:50.466784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9697922-0e08-4884-956a-84f50b13eac2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:50.522400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:50.565522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011075af-a7b3-495f-b14c-a8bac31ca61c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:50.584623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 537/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 14:21:50.590525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9697922-0e08-4884-956a-84f50b13eac2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:50.602891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:50.603499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.603777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.604047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.604773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:50.605078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:50.607052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:50.625614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 546/1083] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 22 14:21:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:50.631237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:50.678685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:50.702099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9697922-0e08-4884-956a-84f50b13eac2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:50.737155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1980661-e90a-4dfb-a297-8032eb1b1f51 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:50.738119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:50.738754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.739031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.739298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.749617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:50.751100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:50.754161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:50.767038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:50.771847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:50.772764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:50.772764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:50.772764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:50.772764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 538/1084] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:50.774254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:50.775724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807692f-b315-487d-af88-e8007faa4c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:50.776337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807692f-b315-487d-af88-e8007faa4c1a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.776613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807692f-b315-487d-af88-e8007faa4c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.776886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807692f-b315-487d-af88-e8007faa4c1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.862084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807692f-b315-487d-af88-e8007faa4c1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:50.863575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807692f-b315-487d-af88-e8007faa4c1a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:50.884173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b72cd-0f72-499e-a33f-4d15654584ab None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:50.913139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:50.922361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddbf90-2a2c-460f-a377-0b9fca0248fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:50.922971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddbf90-2a2c-460f-a377-0b9fca0248fa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.923252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddbf90-2a2c-460f-a377-0b9fca0248fa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.931367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddbf90-2a2c-460f-a377-0b9fca0248fa None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.931367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddbf90-2a2c-460f-a377-0b9fca0248fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:50.931367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddbf90-2a2c-460f-a377-0b9fca0248fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:50.931367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddbf90-2a2c-460f-a377-0b9fca0248fa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:50.937969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 539/1085] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:50.971105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac259-36aa-4b35-b286-0b3e7174db56 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.971388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac259-36aa-4b35-b286-0b3e7174db56 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.971672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac259-36aa-4b35-b286-0b3e7174db56 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.973189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 540/1086] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:21:50.979275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60d2a-cf23-4d1f-b41d-cbf06ba5366b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:50.979557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60d2a-cf23-4d1f-b41d-cbf06ba5366b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:50.979838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60d2a-cf23-4d1f-b41d-cbf06ba5366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:50.992069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 547/1087] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 22 14:21:50.993249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807692f-b315-487d-af88-e8007faa4c1a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.004999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e5e60d2a-cf23-4d1f-b41d-cbf06ba5366b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:51.006263 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e5e60d2a-cf23-4d1f-b41d-cbf06ba5366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:51.014335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:51.080219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 541/1088] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:21:51.108888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807692f-b315-487d-af88-e8007faa4c1a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.145948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.146632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.146914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.147184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.158473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:51.159930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:21:51.176294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:51.177354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:21:51.178721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:21:51.178721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:21:51.178721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:51.178721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 548/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:51.183206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60d2a-cf23-4d1f-b41d-cbf06ba5366b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.297199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60d2a-cf23-4d1f-b41d-cbf06ba5366b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.316325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:51.333283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.333890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.334189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.334460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.335099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:51.335401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:51.336761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:51.347590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 542/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:51.351218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.353211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.417823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:51.451780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7483618-8a0d-4eed-bc63-33c81ab322f3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.451996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b18ae2-1f41-44a6-8acf-f6acad6b6f4d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.485477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.486131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.486354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a84d2-a13b-4a33-bc5c-230448d53377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.486465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.486659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.486980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a84d2-a13b-4a33-bc5c-230448d53377 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.487263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a84d2-a13b-4a33-bc5c-230448d53377 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.487538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a84d2-a13b-4a33-bc5c-230448d53377 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.493183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:51.494639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:51.497948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a84d2-a13b-4a33-bc5c-230448d53377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d23a84d2-a13b-4a33-bc5c-230448d53377 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:51.503193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:51.504281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:51.505151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 549/1091] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:21:51.505873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:51.506791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:21:51.507940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 543/1092] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:21:51.512202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a84d2-a13b-4a33-bc5c-230448d53377 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.512905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.551774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:51.612740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58064d-a7cc-42c2-a674-9f3dc3fe921b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.618827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a84d2-a13b-4a33-bc5c-230448d53377 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.644384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:51.646953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.647566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.647846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.648125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.648814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:51.649121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:51.650601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:51.651955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.652554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.652828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.653269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.657380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:51.657380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:51.657380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:51.663203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 544/1093] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:51.664748 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 550/1094] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:51.670135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.670942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.766899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:51.771064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4c757-ab8e-4760-a2ab-377a6a4b3ba1 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.772476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401682-d2cd-4c2e-a589-e2a85814fa45 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.804574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.805178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.805454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.805716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.806465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] RBAC: Adding query filter params (role.id=8cd79564c7de4789b67106a74a9ae9ff, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=6bc75cc7beb54ef2abd4876b2b35675e) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:51.806716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f675-3827-4bbe-84d1-090c907722e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.806833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:51.807340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f675-3827-4bbe-84d1-090c907722e1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.807618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f675-3827-4bbe-84d1-090c907722e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.807890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f675-3827-4bbe-84d1-090c907722e1 None admin] PATH_INFO: `/v3/users/1e807e93189c4e9b87c304b8851b5074` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.808167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:51.809032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708f675-3827-4bbe-84d1-090c907722e1 None admin] RBAC: Authorizing `identity:get_user(user_id=1e807e93189c4e9b87c304b8851b5074)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:51.810983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708f675-3827-4bbe-84d1-090c907722e1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:51.812555 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 551/1095] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:21:51 2022] GET /identity/v3/users/1e807e93189c4e9b87c304b8851b5074 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:21:51.838015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 545/1096] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:51 2022] GET /identity/v3/role_assignments?user.id=6bc75cc7beb54ef2abd4876b2b35675e&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=8cd79564c7de4789b67106a74a9ae9ff => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:51.838277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f675-3827-4bbe-84d1-090c907722e1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:51.881367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:51.924811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f675-3827-4bbe-84d1-090c907722e1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:51.961019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4b35e-e1df-43be-aeea-254bd04ed754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:51.961662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4b35e-e1df-43be-aeea-254bd04ed754 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:51.961936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4b35e-e1df-43be-aeea-254bd04ed754 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:51.962232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4b35e-e1df-43be-aeea-254bd04ed754 None admin] PATH_INFO: `/v3/projects/c4fb80fb49a24588af033759a7b508dd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:51.963383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4b35e-e1df-43be-aeea-254bd04ed754 None admin] RBAC: Authorizing `identity:get_project(project_id=c4fb80fb49a24588af033759a7b508dd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:51.964805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4b35e-e1df-43be-aeea-254bd04ed754 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:51.967227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 552/1097] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:21:51 2022] GET /identity/v3/projects/c4fb80fb49a24588af033759a7b508dd => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:51.973419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:52.077231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393b583-f78a-4c7c-a455-25992dc8d9cc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:52.112823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0998ad-d61f-4674-be84-9394ead093d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:52.113490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0998ad-d61f-4674-be84-9394ead093d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:52.113768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0998ad-d61f-4674-be84-9394ead093d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:52.114071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0998ad-d61f-4674-be84-9394ead093d9 None admin] PATH_INFO: `/v3/projects/c4fb80fb49a24588af033759a7b508dd/users/1e807e93189c4e9b87c304b8851b5074/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:52.115961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0998ad-d61f-4674-be84-9394ead093d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4fb80fb49a24588af033759a7b508dd, user_id=1e807e93189c4e9b87c304b8851b5074, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:52.117385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0998ad-d61f-4674-be84-9394ead093d9 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:52.263736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 546/1098] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:21:51 2022] PUT /identity/v3/projects/c4fb80fb49a24588af033759a7b508dd/users/1e807e93189c4e9b87c304b8851b5074/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:21:54.437584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724ec2-ecd9-4d97-9b88-c156f0a1b548 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:54.438135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724ec2-ecd9-4d97-9b88-c156f0a1b548 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:54.438135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a724ec2-ecd9-4d97-9b88-c156f0a1b548 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:54.439479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 553/1099] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:54.444838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d398597-54d0-43b7-b00e-d51ee498f465 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:54.445247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d398597-54d0-43b7-b00e-d51ee498f465 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:54.445385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d398597-54d0-43b7-b00e-d51ee498f465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:54.465521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9d398597-54d0-43b7-b00e-d51ee498f465 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:54.467253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9d398597-54d0-43b7-b00e-d51ee498f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:54.491722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:54.541302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 547/1100] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:54.824418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724ec2-ecd9-4d97-9b88-c156f0a1b548 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:54.924487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a724ec2-ecd9-4d97-9b88-c156f0a1b548 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:54.948793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:54.957044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b731259-407b-4754-9ac9-3d4d6537150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:54.957662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b731259-407b-4754-9ac9-3d4d6537150a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:54.957937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b731259-407b-4754-9ac9-3d4d6537150a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:54.958231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b731259-407b-4754-9ac9-3d4d6537150a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:54.968329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b731259-407b-4754-9ac9-3d4d6537150a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1b731259-407b-4754-9ac9-3d4d6537150a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:21:54.973062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:21:54.974203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:21:54.975348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 554/1101] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:21:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:21:54.980720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d398597-54d0-43b7-b00e-d51ee498f465 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:55.079992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d398597-54d0-43b7-b00e-d51ee498f465 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:55.113427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:55.114055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:55.114337 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:55.114609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:55.115276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:55.115578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:55.116944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:55.124985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 548/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:21:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:55.130946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b731259-407b-4754-9ac9-3d4d6537150a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:55.231249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b731259-407b-4754-9ac9-3d4d6537150a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:55.265278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c939-4a6a-4e36-ba84-14afe0171ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:55.265897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c939-4a6a-4e36-ba84-14afe0171ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:55.266206 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c939-4a6a-4e36-ba84-14afe0171ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:55.266476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c939-4a6a-4e36-ba84-14afe0171ab4 None admin] PATH_INFO: `/v3/users/1e807e93189c4e9b87c304b8851b5074` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:55.267578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4c939-4a6a-4e36-ba84-14afe0171ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=1e807e93189c4e9b87c304b8851b5074)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:55.268992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4c939-4a6a-4e36-ba84-14afe0171ab4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:55.270592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 555/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:21:55 2022] GET /identity/v3/users/1e807e93189c4e9b87c304b8851b5074 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:55.276345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:55.292659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:55.374467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b23853-05a5-4c90-9eb3-a48ff265e2bb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:55.407666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130c1ca-c5d0-4f94-ae1f-0d6cb4bd9054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:55.408249 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130c1ca-c5d0-4f94-ae1f-0d6cb4bd9054 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:55.408527 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130c1ca-c5d0-4f94-ae1f-0d6cb4bd9054 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:55.408798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130c1ca-c5d0-4f94-ae1f-0d6cb4bd9054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:55.477014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130c1ca-c5d0-4f94-ae1f-0d6cb4bd9054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:55.478575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130c1ca-c5d0-4f94-ae1f-0d6cb4bd9054 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:55.567073 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:55.657506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 549/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:21:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:21:55.663590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c939-4a6a-4e36-ba84-14afe0171ab4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:55.719062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:55.764657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c939-4a6a-4e36-ba84-14afe0171ab4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:55.797370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b652-8d23-4a88-a7b1-62049d9af212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:55.798004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b652-8d23-4a88-a7b1-62049d9af212 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:55.798281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b652-8d23-4a88-a7b1-62049d9af212 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:55.798549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b652-8d23-4a88-a7b1-62049d9af212 None admin] PATH_INFO: `/v3/projects/c4fb80fb49a24588af033759a7b508dd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:55.799671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b652-8d23-4a88-a7b1-62049d9af212 None admin] RBAC: Authorizing `identity:get_project(project_id=c4fb80fb49a24588af033759a7b508dd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:55.801078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b652-8d23-4a88-a7b1-62049d9af212 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:55.802716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 556/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:21:55 2022] GET /identity/v3/projects/c4fb80fb49a24588af033759a7b508dd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:55.808892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130c1ca-c5d0-4f94-ae1f-0d6cb4bd9054 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:55.906235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130c1ca-c5d0-4f94-ae1f-0d6cb4bd9054 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:55.920318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:55.939934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e8cf9-8f97-467a-8452-c71a9ceefedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:55.940532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8cf9-8f97-467a-8452-c71a9ceefedb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:55.940812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8cf9-8f97-467a-8452-c71a9ceefedb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:55.941083 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e8cf9-8f97-467a-8452-c71a9ceefedb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:55.941801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e8cf9-8f97-467a-8452-c71a9ceefedb None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=c4fb80fb49a24588af033759a7b508dd, user.id=1e807e93189c4e9b87c304b8851b5074) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:21:55.942225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e8cf9-8f97-467a-8452-c71a9ceefedb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:55.943647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e8cf9-8f97-467a-8452-c71a9ceefedb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:55.949201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 550/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:21:55 2022] GET /identity/v3/role_assignments?user.id=1e807e93189c4e9b87c304b8851b5074&scope.project.id=c4fb80fb49a24588af033759a7b508dd&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:58.126762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760663b-0a62-4a55-b2d8-0b252e0ab3c7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:58.127335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760663b-0a62-4a55-b2d8-0b252e0ab3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:58.127335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760663b-0a62-4a55-b2d8-0b252e0ab3c7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:58.128625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 557/1107] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:21:58.133894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81966a4-ab18-4571-b046-26555d3c496e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:58.134362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81966a4-ab18-4571-b046-26555d3c496e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:58.134467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81966a4-ab18-4571-b046-26555d3c496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:58.152801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f81966a4-ab18-4571-b046-26555d3c496e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:21:58.154546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f81966a4-ab18-4571-b046-26555d3c496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:21:58.220525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 551/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:21:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:21:58.498727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760663b-0a62-4a55-b2d8-0b252e0ab3c7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:58.596981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760663b-0a62-4a55-b2d8-0b252e0ab3c7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:58.618908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:58.630838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71692d-ab3a-4038-bc7c-a2fa0e7be9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:58.633592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71692d-ab3a-4038-bc7c-a2fa0e7be9ac None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:58.633592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71692d-ab3a-4038-bc7c-a2fa0e7be9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:58.633592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71692d-ab3a-4038-bc7c-a2fa0e7be9ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:58.633592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71692d-ab3a-4038-bc7c-a2fa0e7be9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:58.634520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71692d-ab3a-4038-bc7c-a2fa0e7be9ac None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:58.636056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 558/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:21:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:21:58.642480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81966a4-ab18-4571-b046-26555d3c496e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:21:58.746178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81966a4-ab18-4571-b046-26555d3c496e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:21:58.755974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:21:58.780777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e4398-1ff3-4117-ac9b-d4f4e608b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:21:58.781389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4398-1ff3-4117-ac9b-d4f4e608b03e None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:21:58.781661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4398-1ff3-4117-ac9b-d4f4e608b03e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:21:58.781929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e4398-1ff3-4117-ac9b-d4f4e608b03e None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:21:58.782601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e4398-1ff3-4117-ac9b-d4f4e608b03e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:21:58.784015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e4398-1ff3-4117-ac9b-d4f4e608b03e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:21:58.925137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 552/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:21:58 2022] POST /identity/v3/users => generated 286 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:22:01.138286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e85996-8625-4666-be6f-7a5e8caa9338 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:01.138827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e85996-8625-4666-be6f-7a5e8caa9338 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:01.138827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e85996-8625-4666-be6f-7a5e8caa9338 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:01.140182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 559/1111] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:01.145426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8f91-5a89-4fa5-adca-174d297d4efd None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:01.145872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8f91-5a89-4fa5-adca-174d297d4efd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:01.146007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e8f91-5a89-4fa5-adca-174d297d4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:01.164680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-845e8f91-5a89-4fa5-adca-174d297d4efd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:01.165892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-845e8f91-5a89-4fa5-adca-174d297d4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:01.232554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 553/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:01.507352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e85996-8625-4666-be6f-7a5e8caa9338 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:01.610269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e85996-8625-4666-be6f-7a5e8caa9338 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:01.643711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9627a-1a16-4768-bcc3-17c8fd596605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:01.644329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9627a-1a16-4768-bcc3-17c8fd596605 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:01.644606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9627a-1a16-4768-bcc3-17c8fd596605 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:01.644881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9627a-1a16-4768-bcc3-17c8fd596605 None admin] PATH_INFO: `/v3/roles/6ab17e0fb4c647c690842276bdf39eeb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:01.646304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9627a-1a16-4768-bcc3-17c8fd596605 None admin] RBAC: Authorizing `identity:get_role(role_id=6ab17e0fb4c647c690842276bdf39eeb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:01.647663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9627a-1a16-4768-bcc3-17c8fd596605 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:01.648968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 560/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:01 2022] GET /identity/v3/roles/6ab17e0fb4c647c690842276bdf39eeb => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:01.654901 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e8f91-5a89-4fa5-adca-174d297d4efd None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:01.743860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:01.751229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e8f91-5a89-4fa5-adca-174d297d4efd None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:01.792406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea153-486c-4dc9-82f9-248cc48e8b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:01.792966 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea153-486c-4dc9-82f9-248cc48e8b0d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:01.793264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea153-486c-4dc9-82f9-248cc48e8b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:01.793540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea153-486c-4dc9-82f9-248cc48e8b0d None admin] PATH_INFO: `/v3/users/647ed6b3df0b4d34a8859d50b9753f21` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:01.806921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdea153-486c-4dc9-82f9-248cc48e8b0d None admin] RBAC: Authorizing `identity:get_user(user_id=647ed6b3df0b4d34a8859d50b9753f21)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:01.808402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdea153-486c-4dc9-82f9-248cc48e8b0d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:01.811695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 554/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:01 2022] GET /identity/v3/users/647ed6b3df0b4d34a8859d50b9753f21 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:01.817469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9627a-1a16-4768-bcc3-17c8fd596605 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:01.876554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:01.919620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9627a-1a16-4768-bcc3-17c8fd596605 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:01.953028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94793d9b-67e3-4806-b380-38d7218080f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:01.953643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793d9b-67e3-4806-b380-38d7218080f4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:01.954083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793d9b-67e3-4806-b380-38d7218080f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:01.954250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793d9b-67e3-4806-b380-38d7218080f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:02.019953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94793d9b-67e3-4806-b380-38d7218080f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:02.021381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94793d9b-67e3-4806-b380-38d7218080f4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:02.077087 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:02.118869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 561/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:22:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:22:02.125915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea153-486c-4dc9-82f9-248cc48e8b0d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:02.224464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea153-486c-4dc9-82f9-248cc48e8b0d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:02.259646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063ff0-26ad-489d-8971-42f8ec2360cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:02.260277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063ff0-26ad-489d-8971-42f8ec2360cb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:02.260552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063ff0-26ad-489d-8971-42f8ec2360cb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:02.260823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063ff0-26ad-489d-8971-42f8ec2360cb None admin] PATH_INFO: `/v3/projects/c4fb80fb49a24588af033759a7b508dd` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:02.261924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063ff0-26ad-489d-8971-42f8ec2360cb None admin] RBAC: Authorizing `identity:get_project(project_id=c4fb80fb49a24588af033759a7b508dd)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:02.263373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063ff0-26ad-489d-8971-42f8ec2360cb None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:02.265052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 555/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:02 2022] GET /identity/v3/projects/c4fb80fb49a24588af033759a7b508dd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:02.271479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94793d9b-67e3-4806-b380-38d7218080f4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:02.367557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94793d9b-67e3-4806-b380-38d7218080f4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:02.399738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b953a1-318b-4e5b-bfd3-eee2f7595c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:02.400318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b953a1-318b-4e5b-bfd3-eee2f7595c96 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:02.400591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b953a1-318b-4e5b-bfd3-eee2f7595c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:02.400856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b953a1-318b-4e5b-bfd3-eee2f7595c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:02.401556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b953a1-318b-4e5b-bfd3-eee2f7595c96 None admin] RBAC: Adding query filter params (role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=c4fb80fb49a24588af033759a7b508dd, user.id=647ed6b3df0b4d34a8859d50b9753f21) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:02.401858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b953a1-318b-4e5b-bfd3-eee2f7595c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:02.403924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b953a1-318b-4e5b-bfd3-eee2f7595c96 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:02.409048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 562/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:22:02 2022] GET /identity/v3/role_assignments?user.id=647ed6b3df0b4d34a8859d50b9753f21&scope.project.id=c4fb80fb49a24588af033759a7b508dd&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:04.539177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f67a7d-565c-4ca0-9faf-5ae13b63bc97 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:04.539744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f67a7d-565c-4ca0-9faf-5ae13b63bc97 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:04.539744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f67a7d-565c-4ca0-9faf-5ae13b63bc97 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:04.540956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 556/1118] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:04.546893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23f47-e979-43fb-84d6-9862e21a053e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:04.547291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23f47-e979-43fb-84d6-9862e21a053e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:04.547432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b23f47-e979-43fb-84d6-9862e21a053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:04.565342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e2b23f47-e979-43fb-84d6-9862e21a053e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:04.566542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e2b23f47-e979-43fb-84d6-9862e21a053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:04.582310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:04.632076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 563/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:04.906175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f67a7d-565c-4ca0-9faf-5ae13b63bc97 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:04.928107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:05.006246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f67a7d-565c-4ca0-9faf-5ae13b63bc97 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:05.039124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1cc58-664d-4696-b710-b677971e4f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:05.039749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1cc58-664d-4696-b710-b677971e4f77 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:05.040027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1cc58-664d-4696-b710-b677971e4f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:05.040300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1cc58-664d-4696-b710-b677971e4f77 None admin] PATH_INFO: `/v3/roles/6ab17e0fb4c647c690842276bdf39eeb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:05.041710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1cc58-664d-4696-b710-b677971e4f77 None admin] RBAC: Authorizing `identity:get_role(role_id=6ab17e0fb4c647c690842276bdf39eeb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:05.043639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1cc58-664d-4696-b710-b677971e4f77 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:05.045030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 557/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:04 2022] GET /identity/v3/roles/6ab17e0fb4c647c690842276bdf39eeb => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:05.050969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b23f47-e979-43fb-84d6-9862e21a053e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:05.145772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b23f47-e979-43fb-84d6-9862e21a053e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:05.179031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a693-61f1-495c-b175-41a2a9e85550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:05.179578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a693-61f1-495c-b175-41a2a9e85550 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:05.179853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a693-61f1-495c-b175-41a2a9e85550 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:05.180125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a693-61f1-495c-b175-41a2a9e85550 None admin] PATH_INFO: `/v3/users/647ed6b3df0b4d34a8859d50b9753f21` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:05.181225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a693-61f1-495c-b175-41a2a9e85550 None admin] RBAC: Authorizing `identity:get_user(user_id=647ed6b3df0b4d34a8859d50b9753f21)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:05.182662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a693-61f1-495c-b175-41a2a9e85550 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:05.184941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 564/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:05 2022] GET /identity/v3/users/647ed6b3df0b4d34a8859d50b9753f21 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:05.190762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1cc58-664d-4696-b710-b677971e4f77 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:05.280831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:05.292641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1cc58-664d-4696-b710-b677971e4f77 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:05.332867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a92bb-c30f-4cf3-a777-4ee4507b53c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:05.333494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a92bb-c30f-4cf3-a777-4ee4507b53c3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:05.333770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a92bb-c30f-4cf3-a777-4ee4507b53c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:05.334068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a92bb-c30f-4cf3-a777-4ee4507b53c3 None admin] PATH_INFO: `/v3/projects/c4fb80fb49a24588af033759a7b508dd` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:05.335179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a92bb-c30f-4cf3-a777-4ee4507b53c3 None admin] RBAC: Authorizing `identity:get_project(project_id=c4fb80fb49a24588af033759a7b508dd)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:05.336603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a92bb-c30f-4cf3-a777-4ee4507b53c3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:05.338289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 558/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:05 2022] GET /identity/v3/projects/c4fb80fb49a24588af033759a7b508dd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:05.345250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a693-61f1-495c-b175-41a2a9e85550 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:05.373142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:05.449043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a693-61f1-495c-b175-41a2a9e85550 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:05.482939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a71b9-a6b2-485a-88a8-f048b4f93bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:05.483586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a71b9-a6b2-485a-88a8-f048b4f93bf1 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:05.483865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a71b9-a6b2-485a-88a8-f048b4f93bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:05.484137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a71b9-a6b2-485a-88a8-f048b4f93bf1 None admin] PATH_INFO: `/v3/projects/c4fb80fb49a24588af033759a7b508dd/users/647ed6b3df0b4d34a8859d50b9753f21/roles/6ab17e0fb4c647c690842276bdf39eeb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:05.486264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a71b9-a6b2-485a-88a8-f048b4f93bf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4fb80fb49a24588af033759a7b508dd, user_id=647ed6b3df0b4d34a8859d50b9753f21, role_id=6ab17e0fb4c647c690842276bdf39eeb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:05.487731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a71b9-a6b2-485a-88a8-f048b4f93bf1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:05.561028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 565/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:22:05 2022] PUT /identity/v3/projects/c4fb80fb49a24588af033759a7b508dd/users/647ed6b3df0b4d34a8859d50b9753f21/roles/6ab17e0fb4c647c690842276bdf39eeb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:22:07.688197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7f73e-a93c-46f6-a10a-abcf6a589570 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:07.688706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7f73e-a93c-46f6-a10a-abcf6a589570 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:07.688706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7f73e-a93c-46f6-a10a-abcf6a589570 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:07.689968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 559/1124] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:07.695285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3939f1e-faa3-4539-a2b1-14fa9a0d69ca None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:07.695728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3939f1e-faa3-4539-a2b1-14fa9a0d69ca None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:07.695839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3939f1e-faa3-4539-a2b1-14fa9a0d69ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:07.714423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d3939f1e-faa3-4539-a2b1-14fa9a0d69ca None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:07.715846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d3939f1e-faa3-4539-a2b1-14fa9a0d69ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:07.781200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 566/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:22:08.055502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7f73e-a93c-46f6-a10a-abcf6a589570 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:08.155535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7f73e-a93c-46f6-a10a-abcf6a589570 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:08.188036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba89c06-8adb-4811-af57-fde1c2dbdfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:08.188653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89c06-8adb-4811-af57-fde1c2dbdfae None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:08.189431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89c06-8adb-4811-af57-fde1c2dbdfae None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:08.189431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba89c06-8adb-4811-af57-fde1c2dbdfae None admin] PATH_INFO: `/v3/roles/6ab17e0fb4c647c690842276bdf39eeb` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:08.190626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba89c06-8adb-4811-af57-fde1c2dbdfae None admin] RBAC: Authorizing `identity:get_role(role_id=6ab17e0fb4c647c690842276bdf39eeb)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:08.191974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba89c06-8adb-4811-af57-fde1c2dbdfae None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:08.193270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 560/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:08 2022] GET /identity/v3/roles/6ab17e0fb4c647c690842276bdf39eeb => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:08.199187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3939f1e-faa3-4539-a2b1-14fa9a0d69ca None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:08.211580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:08.302511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3939f1e-faa3-4539-a2b1-14fa9a0d69ca None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:08.339358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3f15-c363-4ad7-bc53-15b897a45629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:08.340150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3f15-c363-4ad7-bc53-15b897a45629 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:08.340757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3f15-c363-4ad7-bc53-15b897a45629 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:08.341036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d3f15-c363-4ad7-bc53-15b897a45629 None admin] PATH_INFO: `/v3/users/647ed6b3df0b4d34a8859d50b9753f21` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:08.342194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3f15-c363-4ad7-bc53-15b897a45629 None admin] RBAC: Authorizing `identity:get_user(user_id=647ed6b3df0b4d34a8859d50b9753f21)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:08.343678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d3f15-c363-4ad7-bc53-15b897a45629 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:08.345355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 567/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:08 2022] GET /identity/v3/users/647ed6b3df0b4d34a8859d50b9753f21 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:08.351552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba89c06-8adb-4811-af57-fde1c2dbdfae None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:08.376529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:08.454077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba89c06-8adb-4811-af57-fde1c2dbdfae None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:08.487023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87cfa1-8533-49aa-8a6f-451866657f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:08.487649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87cfa1-8533-49aa-8a6f-451866657f97 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:08.487923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87cfa1-8533-49aa-8a6f-451866657f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:08.488189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87cfa1-8533-49aa-8a6f-451866657f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:08.553061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87cfa1-8533-49aa-8a6f-451866657f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:08.554548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87cfa1-8533-49aa-8a6f-451866657f97 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:08.578336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:08.653892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 561/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:22:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:22:08.659924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3f15-c363-4ad7-bc53-15b897a45629 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:08.740773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:08.761115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d3f15-c363-4ad7-bc53-15b897a45629 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:08.794872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3a1b5-d85f-4a23-9e0b-00850a90e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:08.795457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a1b5-d85f-4a23-9e0b-00850a90e66c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:08.795735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a1b5-d85f-4a23-9e0b-00850a90e66c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:08.796005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a1b5-d85f-4a23-9e0b-00850a90e66c None admin] PATH_INFO: `/v3/projects/c4fb80fb49a24588af033759a7b508dd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:08.797125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3a1b5-d85f-4a23-9e0b-00850a90e66c None admin] RBAC: Authorizing `identity:get_project(project_id=c4fb80fb49a24588af033759a7b508dd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:08.798580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3a1b5-d85f-4a23-9e0b-00850a90e66c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:08.800198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 568/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:08 2022] GET /identity/v3/projects/c4fb80fb49a24588af033759a7b508dd => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:08.806511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87cfa1-8533-49aa-8a6f-451866657f97 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:08.907500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87cfa1-8533-49aa-8a6f-451866657f97 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:08.932987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:08.944563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f10d18-e66a-41ce-aafe-6f0016912645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:08.951857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f10d18-e66a-41ce-aafe-6f0016912645 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:08.951857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f10d18-e66a-41ce-aafe-6f0016912645 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:08.951857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f10d18-e66a-41ce-aafe-6f0016912645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:08.951857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f10d18-e66a-41ce-aafe-6f0016912645 None admin] RBAC: Adding query filter params (role.id=6ab17e0fb4c647c690842276bdf39eeb, scope.project.id=c4fb80fb49a24588af033759a7b508dd, user.id=647ed6b3df0b4d34a8859d50b9753f21) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:08.951857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f10d18-e66a-41ce-aafe-6f0016912645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:08.951857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f10d18-e66a-41ce-aafe-6f0016912645 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:08.954376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 562/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:22:08 2022] GET /identity/v3/role_assignments?user.id=647ed6b3df0b4d34a8859d50b9753f21&scope.project.id=c4fb80fb49a24588af033759a7b508dd&role.id=6ab17e0fb4c647c690842276bdf39eeb => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:11.133497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015a955-d6d0-4a6b-9207-0e2795a13166 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:11.134193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015a955-d6d0-4a6b-9207-0e2795a13166 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:11.134193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015a955-d6d0-4a6b-9207-0e2795a13166 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:11.135407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 569/1131] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:11.141656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875986c-54aa-46fc-b954-de0678575851 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:11.142212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875986c-54aa-46fc-b954-de0678575851 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:11.142212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875986c-54aa-46fc-b954-de0678575851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:11.161558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7875986c-54aa-46fc-b954-de0678575851 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:11.162788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7875986c-54aa-46fc-b954-de0678575851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:11.235245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 563/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:11.504167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015a955-d6d0-4a6b-9207-0e2795a13166 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:11.604264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015a955-d6d0-4a6b-9207-0e2795a13166 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:11.638633 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2b3d1-aa4a-4d83-96c8-b21326cd19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:11.639250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2b3d1-aa4a-4d83-96c8-b21326cd19e1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:11.639526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2b3d1-aa4a-4d83-96c8-b21326cd19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:11.639794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2b3d1-aa4a-4d83-96c8-b21326cd19e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:11.640904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2b3d1-aa4a-4d83-96c8-b21326cd19e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:11.642348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2b3d1-aa4a-4d83-96c8-b21326cd19e1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:11.643994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 570/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:22:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:11.650084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875986c-54aa-46fc-b954-de0678575851 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:11.755184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875986c-54aa-46fc-b954-de0678575851 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:11.772851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:11.789771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84d0a-c4ed-47ca-a448-3c327b92c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:11.790415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84d0a-c4ed-47ca-a448-3c327b92c453 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:11.790697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84d0a-c4ed-47ca-a448-3c327b92c453 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:11.790972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84d0a-c4ed-47ca-a448-3c327b92c453 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:11.791626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84d0a-c4ed-47ca-a448-3c327b92c453 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:11.793648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84d0a-c4ed-47ca-a448-3c327b92c453 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:11.969363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 564/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:22:11 2022] POST /identity/v3/projects => generated 311 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:22:14.207207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f5c0-a6cc-4ed7-9ae4-f94196bbb2c6 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:14.207779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f5c0-a6cc-4ed7-9ae4-f94196bbb2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:14.207779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f5c0-a6cc-4ed7-9ae4-f94196bbb2c6 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:14.209240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 571/1135] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:14.214260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85c94d-b4db-438b-b69a-287813d1ed52 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:14.215224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85c94d-b4db-438b-b69a-287813d1ed52 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:14.215337 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85c94d-b4db-438b-b69a-287813d1ed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:14.234753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1c85c94d-b4db-438b-b69a-287813d1ed52 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:14.235949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1c85c94d-b4db-438b-b69a-287813d1ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:14.303239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 565/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:14.572020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46f5c0-a6cc-4ed7-9ae4-f94196bbb2c6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:14.588075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:14.678122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46f5c0-a6cc-4ed7-9ae4-f94196bbb2c6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:14.729760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dc9fb-e262-47a8-8350-0f45ec45c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:14.730453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dc9fb-e262-47a8-8350-0f45ec45c06f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:14.730723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dc9fb-e262-47a8-8350-0f45ec45c06f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:14.731086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dc9fb-e262-47a8-8350-0f45ec45c06f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:14.732191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dc9fb-e262-47a8-8350-0f45ec45c06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:14.733597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dc9fb-e262-47a8-8350-0f45ec45c06f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:14.735190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 572/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:22:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:14.741114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85c94d-b4db-438b-b69a-287813d1ed52 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:14.834845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:14.837595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85c94d-b4db-438b-b69a-287813d1ed52 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:14.871496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc5afd-7b91-4aa3-b6ef-165146532871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:14.872095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5afd-7b91-4aa3-b6ef-165146532871 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:14.872370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5afd-7b91-4aa3-b6ef-165146532871 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:14.872635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5afd-7b91-4aa3-b6ef-165146532871 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:14.873339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc5afd-7b91-4aa3-b6ef-165146532871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:14.874774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc5afd-7b91-4aa3-b6ef-165146532871 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:14.989572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 566/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:22:14 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:22:17.221935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094121d-ded0-4e0d-a58f-b456a66fe78d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:17.222516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094121d-ded0-4e0d-a58f-b456a66fe78d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:17.222516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094121d-ded0-4e0d-a58f-b456a66fe78d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:17.223817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 573/1139] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:17.229450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866d377-b539-4af7-944a-48d333b04e7c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:17.229871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866d377-b539-4af7-944a-48d333b04e7c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:17.230027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866d377-b539-4af7-944a-48d333b04e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:17.248654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7866d377-b539-4af7-944a-48d333b04e7c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:17.249838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7866d377-b539-4af7-944a-48d333b04e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:17.315351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 567/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:17.584585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094121d-ded0-4e0d-a58f-b456a66fe78d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:17.667176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:17.686650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094121d-ded0-4e0d-a58f-b456a66fe78d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:17.720759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256fd6-5b3c-43d8-9b9c-e3081ae7abdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:17.721378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256fd6-5b3c-43d8-9b9c-e3081ae7abdf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:17.721656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256fd6-5b3c-43d8-9b9c-e3081ae7abdf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:17.721923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f256fd6-5b3c-43d8-9b9c-e3081ae7abdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:17.732758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f256fd6-5b3c-43d8-9b9c-e3081ae7abdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9f256fd6-5b3c-43d8-9b9c-e3081ae7abdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:22:17.737580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:22:17.738773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:22:17.739991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 574/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:22:17.744812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866d377-b539-4af7-944a-48d333b04e7c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:17.830046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:17.845209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866d377-b539-4af7-944a-48d333b04e7c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:17.880377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:17.880981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:17.881261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:17.881533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:17.882228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:17.882551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:17.883948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:17.892434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 568/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:17.898404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256fd6-5b3c-43d8-9b9c-e3081ae7abdf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:17.997170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f256fd6-5b3c-43d8-9b9c-e3081ae7abdf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:18.030374 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2766bc-9f1b-4742-a1ec-e081bba8821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:18.030993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2766bc-9f1b-4742-a1ec-e081bba8821d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:18.031268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2766bc-9f1b-4742-a1ec-e081bba8821d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:18.031536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2766bc-9f1b-4742-a1ec-e081bba8821d None admin] PATH_INFO: `/v3/users/940b9ea59f8f496b8682a04da45fd101` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:18.042445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:18.045411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2766bc-9f1b-4742-a1ec-e081bba8821d None admin] RBAC: Authorizing `identity:get_user(user_id=940b9ea59f8f496b8682a04da45fd101)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:18.046832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2766bc-9f1b-4742-a1ec-e081bba8821d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:18.048429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 575/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:17 2022] GET /identity/v3/users/940b9ea59f8f496b8682a04da45fd101 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:18.054356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:18.154397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3498ca-8f18-4a0b-9cdb-0ebc11daed41 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:18.187723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9d52d-5873-4205-bd90-d77abdafbf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:18.188320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9d52d-5873-4205-bd90-d77abdafbf9b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:18.188592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9d52d-5873-4205-bd90-d77abdafbf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:18.188859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9d52d-5873-4205-bd90-d77abdafbf9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:18.206361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:18.257631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9d52d-5873-4205-bd90-d77abdafbf9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:18.259240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9d52d-5873-4205-bd90-d77abdafbf9b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:18.356777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 569/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:22:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:22:18.363065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2766bc-9f1b-4742-a1ec-e081bba8821d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:18.458851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2766bc-9f1b-4742-a1ec-e081bba8821d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:18.492544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc84e4b-2d96-479b-abad-c33016c84f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:18.493161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc84e4b-2d96-479b-abad-c33016c84f06 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:18.493439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc84e4b-2d96-479b-abad-c33016c84f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:18.493711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc84e4b-2d96-479b-abad-c33016c84f06 None admin] PATH_INFO: `/v3/projects/44caf0761ecc42afa1b5d77d9ed87dc7` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:18.494858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc84e4b-2d96-479b-abad-c33016c84f06 None admin] RBAC: Authorizing `identity:get_project(project_id=44caf0761ecc42afa1b5d77d9ed87dc7)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:18.496423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc84e4b-2d96-479b-abad-c33016c84f06 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:18.498071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 576/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:18 2022] GET /identity/v3/projects/44caf0761ecc42afa1b5d77d9ed87dc7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:18.504690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9d52d-5873-4205-bd90-d77abdafbf9b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:18.554663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:18.604432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9d52d-5873-4205-bd90-d77abdafbf9b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:18.638097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ba916-8814-4bf2-9682-01fcfef4e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:18.638724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba916-8814-4bf2-9682-01fcfef4e387 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:18.639006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba916-8814-4bf2-9682-01fcfef4e387 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:18.639285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ba916-8814-4bf2-9682-01fcfef4e387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:18.640031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ba916-8814-4bf2-9682-01fcfef4e387 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=44caf0761ecc42afa1b5d77d9ed87dc7, user.id=940b9ea59f8f496b8682a04da45fd101) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:18.640411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ba916-8814-4bf2-9682-01fcfef4e387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:18.641921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ba916-8814-4bf2-9682-01fcfef4e387 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:18.647954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 570/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:22:18 2022] GET /identity/v3/role_assignments?user.id=940b9ea59f8f496b8682a04da45fd101&scope.project.id=44caf0761ecc42afa1b5d77d9ed87dc7&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:20.799436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9515f-96e0-4b55-9c9a-bc2362879386 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:20.800004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9515f-96e0-4b55-9c9a-bc2362879386 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:20.800100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9515f-96e0-4b55-9c9a-bc2362879386 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:20.801394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 577/1147] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:20.806543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8b72f-10b5-419f-b73e-62904c769f70 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:20.806991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8b72f-10b5-419f-b73e-62904c769f70 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:20.807095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8b72f-10b5-419f-b73e-62904c769f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:20.825736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-06d8b72f-10b5-419f-b73e-62904c769f70 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:20.826958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-06d8b72f-10b5-419f-b73e-62904c769f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:20.892901 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 571/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:22:21.161467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9515f-96e0-4b55-9c9a-bc2362879386 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:21.228246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:21.263145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9515f-96e0-4b55-9c9a-bc2362879386 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:21.296108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460caaf-59c3-4a7b-bf75-16999ae062e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:21.296720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460caaf-59c3-4a7b-bf75-16999ae062e0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:21.296995 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460caaf-59c3-4a7b-bf75-16999ae062e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:21.297262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460caaf-59c3-4a7b-bf75-16999ae062e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:21.307063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460caaf-59c3-4a7b-bf75-16999ae062e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3460caaf-59c3-4a7b-bf75-16999ae062e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:22:21.312331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:22:21.313462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:22:21.314346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 578/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:22:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:22:21.319694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8b72f-10b5-419f-b73e-62904c769f70 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:21.363944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:21.427892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8b72f-10b5-419f-b73e-62904c769f70 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:21.464801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:21.465561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:21.465837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:21.466138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:21.466799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:21.467097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:21.468445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:21.476507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 572/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:22:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:21.482938 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460caaf-59c3-4a7b-bf75-16999ae062e0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:21.580650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460caaf-59c3-4a7b-bf75-16999ae062e0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:21.607392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:21.614902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508c201-6570-4a89-8f16-72959a85c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:21.615518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c201-6570-4a89-8f16-72959a85c323 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:21.615794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c201-6570-4a89-8f16-72959a85c323 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:21.616063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c201-6570-4a89-8f16-72959a85c323 None admin] PATH_INFO: `/v3/users/940b9ea59f8f496b8682a04da45fd101` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:21.617175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508c201-6570-4a89-8f16-72959a85c323 None admin] RBAC: Authorizing `identity:get_user(user_id=940b9ea59f8f496b8682a04da45fd101)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:21.618611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508c201-6570-4a89-8f16-72959a85c323 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:21.630157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 579/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:21 2022] GET /identity/v3/users/940b9ea59f8f496b8682a04da45fd101 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:21.630368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:21.725241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a21fb-622a-4227-a37f-10d036a35035 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:21.727559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:21.760995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55113e-5fc5-48c7-a1b2-d99a5264424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:21.762474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55113e-5fc5-48c7-a1b2-d99a5264424b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:21.762987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55113e-5fc5-48c7-a1b2-d99a5264424b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:21.763598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55113e-5fc5-48c7-a1b2-d99a5264424b None admin] PATH_INFO: `/v3/projects/44caf0761ecc42afa1b5d77d9ed87dc7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:21.764988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55113e-5fc5-48c7-a1b2-d99a5264424b None admin] RBAC: Authorizing `identity:get_project(project_id=44caf0761ecc42afa1b5d77d9ed87dc7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:21.766454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55113e-5fc5-48c7-a1b2-d99a5264424b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:21.768116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 573/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:21 2022] GET /identity/v3/projects/44caf0761ecc42afa1b5d77d9ed87dc7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:21.774226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508c201-6570-4a89-8f16-72959a85c323 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:21.871624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508c201-6570-4a89-8f16-72959a85c323 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:21.905570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becfbae-ccb4-430a-aef1-ea650e512ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:21.906247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfbae-ccb4-430a-aef1-ea650e512ab6 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:21.906525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfbae-ccb4-430a-aef1-ea650e512ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:21.906796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becfbae-ccb4-430a-aef1-ea650e512ab6 None admin] PATH_INFO: `/v3/projects/44caf0761ecc42afa1b5d77d9ed87dc7/users/940b9ea59f8f496b8682a04da45fd101/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:21.908682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becfbae-ccb4-430a-aef1-ea650e512ab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=44caf0761ecc42afa1b5d77d9ed87dc7, user_id=940b9ea59f8f496b8682a04da45fd101, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:21.910113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becfbae-ccb4-430a-aef1-ea650e512ab6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:22.001085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 580/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:22:21 2022] PUT /identity/v3/projects/44caf0761ecc42afa1b5d77d9ed87dc7/users/940b9ea59f8f496b8682a04da45fd101/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:22:24.149533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b7c2-4e68-4ab2-89c9-6dde72a5d5f9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:24.150128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b7c2-4e68-4ab2-89c9-6dde72a5d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:24.150128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655b7c2-4e68-4ab2-89c9-6dde72a5d5f9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:24.151443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 574/1154] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:24.157664 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c974e-67b8-4519-bbec-85432f533bd0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:24.158137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c974e-67b8-4519-bbec-85432f533bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:24.158244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c974e-67b8-4519-bbec-85432f533bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:24.176463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-320c974e-67b8-4519-bbec-85432f533bd0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:24.177639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-320c974e-67b8-4519-bbec-85432f533bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:24.226509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:24.243034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 581/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:24.517660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655b7c2-4e68-4ab2-89c9-6dde72a5d5f9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:24.618938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655b7c2-4e68-4ab2-89c9-6dde72a5d5f9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:24.651176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add47704-18d8-4262-b194-9bbaf92389c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:24.652616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add47704-18d8-4262-b194-9bbaf92389c5 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:24.652899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add47704-18d8-4262-b194-9bbaf92389c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:24.653171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add47704-18d8-4262-b194-9bbaf92389c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:24.663398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add47704-18d8-4262-b194-9bbaf92389c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-add47704-18d8-4262-b194-9bbaf92389c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:22:24.668472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:22:24.669607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:22:24.670554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 575/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:22:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:22:24.675986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c974e-67b8-4519-bbec-85432f533bd0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:24.777654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c974e-67b8-4519-bbec-85432f533bd0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:24.811695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:24.812295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:24.812576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:24.812850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:24.813509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:24.813813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:24.815217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:24.823114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 582/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:22:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:22:24.829923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add47704-18d8-4262-b194-9bbaf92389c5 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:24.860892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:24.927907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add47704-18d8-4262-b194-9bbaf92389c5 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:24.961085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4650c-318f-4cc5-a771-33fdba677a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:24.961699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4650c-318f-4cc5-a771-33fdba677a5f None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:24.962003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4650c-318f-4cc5-a771-33fdba677a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:24.962360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4650c-318f-4cc5-a771-33fdba677a5f None admin] PATH_INFO: `/v3/users/940b9ea59f8f496b8682a04da45fd101` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:24.963449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4650c-318f-4cc5-a771-33fdba677a5f None admin] RBAC: Authorizing `identity:get_user(user_id=940b9ea59f8f496b8682a04da45fd101)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:24.964895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4650c-318f-4cc5-a771-33fdba677a5f None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:24.966463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 576/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:24 2022] GET /identity/v3/users/940b9ea59f8f496b8682a04da45fd101 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:24.972385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:25.021228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:25.069878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b992-312e-4225-bc9d-c77cec67fbe8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:25.103265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711db8ed-dbd1-4952-a835-7eac126765f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:25.103856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db8ed-dbd1-4952-a835-7eac126765f8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:25.104134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db8ed-dbd1-4952-a835-7eac126765f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:25.104407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db8ed-dbd1-4952-a835-7eac126765f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:25.170211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711db8ed-dbd1-4952-a835-7eac126765f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:25.171654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711db8ed-dbd1-4952-a835-7eac126765f8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:25.217515 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:25.269032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 583/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:22:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:22:25.275009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4650c-318f-4cc5-a771-33fdba677a5f None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:25.371860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:25.374754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4650c-318f-4cc5-a771-33fdba677a5f None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:25.410833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d38617-bcf0-4b37-8dac-dfb14cf5307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:25.411460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38617-bcf0-4b37-8dac-dfb14cf5307c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:25.411739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38617-bcf0-4b37-8dac-dfb14cf5307c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:25.412013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38617-bcf0-4b37-8dac-dfb14cf5307c None admin] PATH_INFO: `/v3/projects/44caf0761ecc42afa1b5d77d9ed87dc7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:25.413197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d38617-bcf0-4b37-8dac-dfb14cf5307c None admin] RBAC: Authorizing `identity:get_project(project_id=44caf0761ecc42afa1b5d77d9ed87dc7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:25.414674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d38617-bcf0-4b37-8dac-dfb14cf5307c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:25.416305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 577/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:25 2022] GET /identity/v3/projects/44caf0761ecc42afa1b5d77d9ed87dc7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:25.424620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711db8ed-dbd1-4952-a835-7eac126765f8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:25.521760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711db8ed-dbd1-4952-a835-7eac126765f8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:25.555669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ad02d-6341-4085-808c-3ae9ad24dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:25.556274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad02d-6341-4085-808c-3ae9ad24dec6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:25.556547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad02d-6341-4085-808c-3ae9ad24dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:25.556814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad02d-6341-4085-808c-3ae9ad24dec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:25.557524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ad02d-6341-4085-808c-3ae9ad24dec6 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=44caf0761ecc42afa1b5d77d9ed87dc7, user.id=940b9ea59f8f496b8682a04da45fd101) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:25.557824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ad02d-6341-4085-808c-3ae9ad24dec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:25.559475 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ad02d-6341-4085-808c-3ae9ad24dec6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:25.565071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 584/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:22:25 2022] GET /identity/v3/role_assignments?user.id=940b9ea59f8f496b8682a04da45fd101&scope.project.id=44caf0761ecc42afa1b5d77d9ed87dc7&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:27.760590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb02a6-e109-4686-b608-9618494a3340 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:27.761110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb02a6-e109-4686-b608-9618494a3340 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:27.761203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb02a6-e109-4686-b608-9618494a3340 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:27.762512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 578/1162] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:27.767776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27b10-eac4-46b1-b686-da0ee8395531 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:27.768182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27b10-eac4-46b1-b686-da0ee8395531 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:27.768325 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee27b10-eac4-46b1-b686-da0ee8395531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:27.786549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4ee27b10-eac4-46b1-b686-da0ee8395531 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:27.787738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4ee27b10-eac4-46b1-b686-da0ee8395531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:27.795417 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:27.852234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 585/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:28.122985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb02a6-e109-4686-b608-9618494a3340 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:28.226286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb02a6-e109-4686-b608-9618494a3340 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:28.260252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214a4cd-bc17-4a8c-ae96-e5c7e6bb89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:28.260857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214a4cd-bc17-4a8c-ae96-e5c7e6bb89ef None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:28.261846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214a4cd-bc17-4a8c-ae96-e5c7e6bb89ef None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:28.262282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214a4cd-bc17-4a8c-ae96-e5c7e6bb89ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:28.296065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:28.327956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214a4cd-bc17-4a8c-ae96-e5c7e6bb89ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:28.329383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214a4cd-bc17-4a8c-ae96-e5c7e6bb89ef None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:28.423927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 579/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:22:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:22:28.429916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee27b10-eac4-46b1-b686-da0ee8395531 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:28.526261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee27b10-eac4-46b1-b686-da0ee8395531 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:28.559394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a58bd-d718-4fee-bb71-8e3e265a22ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:28.560013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a58bd-d718-4fee-bb71-8e3e265a22ee None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:28.560292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a58bd-d718-4fee-bb71-8e3e265a22ee None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:28.560561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a58bd-d718-4fee-bb71-8e3e265a22ee None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:28.566972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a58bd-d718-4fee-bb71-8e3e265a22ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:28.568404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a58bd-d718-4fee-bb71-8e3e265a22ee None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f33a58bd-d718-4fee-bb71-8e3e265a22ee None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:22:28.580061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:22:28.581310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:22:28.582259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 586/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:22:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:22:28.587188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214a4cd-bc17-4a8c-ae96-e5c7e6bb89ef None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:28.652543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:28.685816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214a4cd-bc17-4a8c-ae96-e5c7e6bb89ef None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:28.718874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2c5d5-fbdf-411c-927e-244b78e724b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:28.719475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c5d5-fbdf-411c-927e-244b78e724b3 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:28.719753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c5d5-fbdf-411c-927e-244b78e724b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:28.720024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c5d5-fbdf-411c-927e-244b78e724b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:28.720661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2c5d5-fbdf-411c-927e-244b78e724b3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:28.720961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2c5d5-fbdf-411c-927e-244b78e724b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:28.722346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2c5d5-fbdf-411c-927e-244b78e724b3 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:28.729481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 580/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 22 14:22:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:30.906106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499e80d-a9b5-4554-8abf-f3192b719809 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:30.906636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499e80d-a9b5-4554-8abf-f3192b719809 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:30.906729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499e80d-a9b5-4554-8abf-f3192b719809 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:30.908048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 587/1167] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:30.913126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4985-5190-4e61-8b6c-33b22e77e845 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:30.913525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4985-5190-4e61-8b6c-33b22e77e845 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:30.913735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4985-5190-4e61-8b6c-33b22e77e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:30.932269 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-45db4985-5190-4e61-8b6c-33b22e77e845 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:30.933604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-45db4985-5190-4e61-8b6c-33b22e77e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:30.998769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 581/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:31.268814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499e80d-a9b5-4554-8abf-f3192b719809 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:31.271781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:31.373050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499e80d-a9b5-4554-8abf-f3192b719809 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:31.407106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6adf33-9e3d-4133-9478-324d6cf7b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:31.407702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6adf33-9e3d-4133-9478-324d6cf7b5ef None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:31.407984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6adf33-9e3d-4133-9478-324d6cf7b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:31.408259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6adf33-9e3d-4133-9478-324d6cf7b5ef None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:31.408922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6adf33-9e3d-4133-9478-324d6cf7b5ef None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:31.410317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6adf33-9e3d-4133-9478-324d6cf7b5ef None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:31.527858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 588/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Thu Sep 22 14:22:31 2022] POST /identity/v3/domains => generated 267 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:22:33.747060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b264e4-b2ea-4242-baf4-fc32931d0446 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:33.747585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b264e4-b2ea-4242-baf4-fc32931d0446 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:33.747585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b264e4-b2ea-4242-baf4-fc32931d0446 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:33.749300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 582/1170] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:33.754618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db704-65f2-4f8b-b2cc-c4b44b8e0981 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:33.755022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db704-65f2-4f8b-b2cc-c4b44b8e0981 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:33.755165 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db704-65f2-4f8b-b2cc-c4b44b8e0981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:33.773073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-240db704-65f2-4f8b-b2cc-c4b44b8e0981 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:33.774281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-240db704-65f2-4f8b-b2cc-c4b44b8e0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:33.829259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:33.839743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 589/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:34.112414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b264e4-b2ea-4242-baf4-fc32931d0446 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:34.175866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:34.216694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b264e4-b2ea-4242-baf4-fc32931d0446 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:34.249936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720e8e2-2671-4127-8684-bc1e8394ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:34.250583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720e8e2-2671-4127-8684-bc1e8394ff61 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:34.250857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720e8e2-2671-4127-8684-bc1e8394ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:34.251124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720e8e2-2671-4127-8684-bc1e8394ff61 None admin] PATH_INFO: `/v3/domains/f5afc11e4fa04bdabbbf36eea4e84d8f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:34.261689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720e8e2-2671-4127-8684-bc1e8394ff61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f5afc11e4fa04bdabbbf36eea4e84d8f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:34.263143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720e8e2-2671-4127-8684-bc1e8394ff61 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:34.264809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 583/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Sep 22 14:22:34 2022] GET /identity/v3/domains/f5afc11e4fa04bdabbbf36eea4e84d8f => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:34.270703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240db704-65f2-4f8b-b2cc-c4b44b8e0981 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:34.368972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240db704-65f2-4f8b-b2cc-c4b44b8e0981 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:34.403097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37013-5d8b-4de8-98b5-769bf09716cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:34.403687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37013-5d8b-4de8-98b5-769bf09716cb None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:34.403959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37013-5d8b-4de8-98b5-769bf09716cb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:34.404223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37013-5d8b-4de8-98b5-769bf09716cb None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:34.404855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37013-5d8b-4de8-98b5-769bf09716cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:34.406283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37013-5d8b-4de8-98b5-769bf09716cb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:34.483930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 590/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:22:34 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:22:36.773383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e764a-8774-4156-85bb-4c93d8323810 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:36.773934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e764a-8774-4156-85bb-4c93d8323810 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:36.773934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e764a-8774-4156-85bb-4c93d8323810 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:36.775291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 584/1174] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:36.780559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e8802-f160-4e86-b77f-79f1c8b51afb None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:36.780951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e8802-f160-4e86-b77f-79f1c8b51afb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:36.781103 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e8802-f160-4e86-b77f-79f1c8b51afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:36.803118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6a1e8802-f160-4e86-b77f-79f1c8b51afb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:36.804299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6a1e8802-f160-4e86-b77f-79f1c8b51afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:36.846592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:36.872564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 591/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:37.158892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e764a-8774-4156-85bb-4c93d8323810 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:37.260530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e764a-8774-4156-85bb-4c93d8323810 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:37.283376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:37.294573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499547a-6811-41d3-9dbf-ad2f9476c83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:37.298386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499547a-6811-41d3-9dbf-ad2f9476c83c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:37.298386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499547a-6811-41d3-9dbf-ad2f9476c83c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:37.298386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499547a-6811-41d3-9dbf-ad2f9476c83c None admin] PATH_INFO: `/v3/domains/f5afc11e4fa04bdabbbf36eea4e84d8f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:37.298386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499547a-6811-41d3-9dbf-ad2f9476c83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=f5afc11e4fa04bdabbbf36eea4e84d8f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:37.298386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499547a-6811-41d3-9dbf-ad2f9476c83c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:37.299926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 585/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Sep 22 14:22:37 2022] GET /identity/v3/domains/f5afc11e4fa04bdabbbf36eea4e84d8f => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:37.305747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e8802-f160-4e86-b77f-79f1c8b51afb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:37.403266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e8802-f160-4e86-b77f-79f1c8b51afb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:37.436068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660ad57-66ae-4d6e-86f5-1919c77b2dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:37.436599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ad57-66ae-4d6e-86f5-1919c77b2dbd None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:37.436877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ad57-66ae-4d6e-86f5-1919c77b2dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:37.437145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ad57-66ae-4d6e-86f5-1919c77b2dbd None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:37.437785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660ad57-66ae-4d6e-86f5-1919c77b2dbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:37.439223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660ad57-66ae-4d6e-86f5-1919c77b2dbd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:37.551404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 592/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:22:37 2022] POST /identity/v3/users => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:22:39.747843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b59e3-f84e-4de2-8637-f57cde60486a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:39.748361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b59e3-f84e-4de2-8637-f57cde60486a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:39.748453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b59e3-f84e-4de2-8637-f57cde60486a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:39.749715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 586/1178] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:39.754874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608862e3-c617-484f-9cc7-b73d0603d632 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:39.755282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608862e3-c617-484f-9cc7-b73d0603d632 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:39.755422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608862e3-c617-484f-9cc7-b73d0603d632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:39.773256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-608862e3-c617-484f-9cc7-b73d0603d632 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:39.774484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-608862e3-c617-484f-9cc7-b73d0603d632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:39.798176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:39.839931 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 593/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:22:40.110584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b59e3-f84e-4de2-8637-f57cde60486a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:40.212061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b59e3-f84e-4de2-8637-f57cde60486a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:40.245265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e080e0b-f0b2-4d2f-ae77-8ec03bfb1114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:40.245897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080e0b-f0b2-4d2f-ae77-8ec03bfb1114 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:40.246213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080e0b-f0b2-4d2f-ae77-8ec03bfb1114 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:40.246480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e080e0b-f0b2-4d2f-ae77-8ec03bfb1114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:40.256834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e080e0b-f0b2-4d2f-ae77-8ec03bfb1114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-4e080e0b-f0b2-4d2f-ae77-8ec03bfb1114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:22:40.262331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:22:40.263484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:22:40.264419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 587/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:22:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:22:40.269503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608862e3-c617-484f-9cc7-b73d0603d632 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:40.364854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608862e3-c617-484f-9cc7-b73d0603d632 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:40.397434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:40.398055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:40.398337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:40.398606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:40.399271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:40.399565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:40.400918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:40.409667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 594/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:22:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:22:40.415988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e080e0b-f0b2-4d2f-ae77-8ec03bfb1114 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:40.467329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:40.517971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e080e0b-f0b2-4d2f-ae77-8ec03bfb1114 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:40.551311 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03d27-c428-4ef3-895b-75debcc559af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:40.552073 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03d27-c428-4ef3-895b-75debcc559af None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:40.552352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03d27-c428-4ef3-895b-75debcc559af None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:40.552623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03d27-c428-4ef3-895b-75debcc559af None admin] PATH_INFO: `/v3/users/190f12904f5e4669a487b92a5a229687` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:40.566475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a03d27-c428-4ef3-895b-75debcc559af None admin] RBAC: Authorizing `identity:get_user(user_id=190f12904f5e4669a487b92a5a229687)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:40.567909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a03d27-c428-4ef3-895b-75debcc559af None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:40.569516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 588/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:40 2022] GET /identity/v3/users/190f12904f5e4669a487b92a5a229687 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:40.576634 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:40.601079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:40.675800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892546e2-ee91-400b-8f4f-83798e0848fe None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:40.708990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244a00d-300e-4bc8-a3ae-676f3eb8e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:40.709584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a00d-300e-4bc8-a3ae-676f3eb8e2bc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:40.709861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a00d-300e-4bc8-a3ae-676f3eb8e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:40.710161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a00d-300e-4bc8-a3ae-676f3eb8e2bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:40.775631 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244a00d-300e-4bc8-a3ae-676f3eb8e2bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:40.777116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244a00d-300e-4bc8-a3ae-676f3eb8e2bc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:40.803761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:40.877571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 595/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:22:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:22:40.883716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03d27-c428-4ef3-895b-75debcc559af None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:40.981707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a03d27-c428-4ef3-895b-75debcc559af None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:40.990685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:41.014946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5de129-12c6-44c6-ab39-ecbdfab20a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:41.015572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de129-12c6-44c6-ab39-ecbdfab20a8e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:41.015848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de129-12c6-44c6-ab39-ecbdfab20a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:41.016118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de129-12c6-44c6-ab39-ecbdfab20a8e None admin] PATH_INFO: `/v3/projects/3057d6f9cfde4b719bcf402023245274` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:41.017321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5de129-12c6-44c6-ab39-ecbdfab20a8e None admin] RBAC: Authorizing `identity:get_project(project_id=3057d6f9cfde4b719bcf402023245274)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:41.018804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5de129-12c6-44c6-ab39-ecbdfab20a8e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:41.020445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 589/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:40 2022] GET /identity/v3/projects/3057d6f9cfde4b719bcf402023245274 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:41.026713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244a00d-300e-4bc8-a3ae-676f3eb8e2bc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:41.125172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244a00d-300e-4bc8-a3ae-676f3eb8e2bc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:41.146522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:41.158133 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da969cd-0642-47f8-ad4b-1b9d470b48e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:41.173641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da969cd-0642-47f8-ad4b-1b9d470b48e9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:41.173641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da969cd-0642-47f8-ad4b-1b9d470b48e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:41.173641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da969cd-0642-47f8-ad4b-1b9d470b48e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:41.173641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da969cd-0642-47f8-ad4b-1b9d470b48e9 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=3057d6f9cfde4b719bcf402023245274, user.id=190f12904f5e4669a487b92a5a229687) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:41.173641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da969cd-0642-47f8-ad4b-1b9d470b48e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:41.173641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da969cd-0642-47f8-ad4b-1b9d470b48e9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:41.174198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 596/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:22:41 2022] GET /identity/v3/role_assignments?user.id=190f12904f5e4669a487b92a5a229687&scope.project.id=3057d6f9cfde4b719bcf402023245274&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:43.300208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb8de-3f42-4476-aa32-cf5496ae3cc9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:43.300764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb8de-3f42-4476-aa32-cf5496ae3cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:43.300764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb8de-3f42-4476-aa32-cf5496ae3cc9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:43.302084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 590/1186] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:43.307194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0594-36b3-4236-b138-9216235840fe None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:43.307789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0594-36b3-4236-b138-9216235840fe None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:43.307789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f0594-36b3-4236-b138-9216235840fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:43.326384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-174f0594-36b3-4236-b138-9216235840fe None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:43.327575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-174f0594-36b3-4236-b138-9216235840fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:43.394125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 597/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:22:43.667963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb8de-3f42-4476-aa32-cf5496ae3cc9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:43.768544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb8de-3f42-4476-aa32-cf5496ae3cc9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:43.802074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00c585-a727-4ece-817a-b3e0434e5029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:43.802689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c585-a727-4ece-817a-b3e0434e5029 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:43.802970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c585-a727-4ece-817a-b3e0434e5029 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:43.803244 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c585-a727-4ece-817a-b3e0434e5029 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:43.814127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00c585-a727-4ece-817a-b3e0434e5029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-3b00c585-a727-4ece-817a-b3e0434e5029 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:22:43.818971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:22:43.820166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:22:43.821077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 591/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:22:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:22:43.826847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0594-36b3-4236-b138-9216235840fe None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:43.924355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f0594-36b3-4236-b138-9216235840fe None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:43.939906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:43.957270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:43.957867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:43.958205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:43.958485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:43.959140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:43.959442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:43.960789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:43.969224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 598/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:22:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:43.975375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00c585-a727-4ece-817a-b3e0434e5029 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:44.010103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:44.073409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00c585-a727-4ece-817a-b3e0434e5029 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:44.107647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0a60-58fc-4436-832f-d39a068c48e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:44.108261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0a60-58fc-4436-832f-d39a068c48e8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:44.108537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0a60-58fc-4436-832f-d39a068c48e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:44.108804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0a60-58fc-4436-832f-d39a068c48e8 None admin] PATH_INFO: `/v3/users/190f12904f5e4669a487b92a5a229687` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:44.109910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf0a60-58fc-4436-832f-d39a068c48e8 None admin] RBAC: Authorizing `identity:get_user(user_id=190f12904f5e4669a487b92a5a229687)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:44.111547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf0a60-58fc-4436-832f-d39a068c48e8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:44.113096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 592/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:43 2022] GET /identity/v3/users/190f12904f5e4669a487b92a5a229687 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:44.118876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:44.216250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a6cc5-0bc1-418a-9b69-ce072797e3d5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:44.249214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d17d0d-130e-434e-b8e3-c71bdb86b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:44.249832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17d0d-130e-434e-b8e3-c71bdb86b030 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:44.250146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17d0d-130e-434e-b8e3-c71bdb86b030 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:44.250413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17d0d-130e-434e-b8e3-c71bdb86b030 None admin] PATH_INFO: `/v3/projects/3057d6f9cfde4b719bcf402023245274` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:44.251515 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d17d0d-130e-434e-b8e3-c71bdb86b030 None admin] RBAC: Authorizing `identity:get_project(project_id=3057d6f9cfde4b719bcf402023245274)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:44.252968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d17d0d-130e-434e-b8e3-c71bdb86b030 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:44.254654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 599/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:44 2022] GET /identity/v3/projects/3057d6f9cfde4b719bcf402023245274 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:44.261195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0a60-58fc-4436-832f-d39a068c48e8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:44.356999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0a60-58fc-4436-832f-d39a068c48e8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:44.359307 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:44.391049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f097a8d-7430-4de6-a7fd-7a22aa3592b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:44.391799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097a8d-7430-4de6-a7fd-7a22aa3592b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:44.392075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097a8d-7430-4de6-a7fd-7a22aa3592b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:44.392392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f097a8d-7430-4de6-a7fd-7a22aa3592b7 None admin] PATH_INFO: `/v3/projects/3057d6f9cfde4b719bcf402023245274/users/190f12904f5e4669a487b92a5a229687/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:44.394243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f097a8d-7430-4de6-a7fd-7a22aa3592b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3057d6f9cfde4b719bcf402023245274, user_id=190f12904f5e4669a487b92a5a229687, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:44.395797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f097a8d-7430-4de6-a7fd-7a22aa3592b7 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:44.475090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 593/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:22:44 2022] PUT /identity/v3/projects/3057d6f9cfde4b719bcf402023245274/users/190f12904f5e4669a487b92a5a229687/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:22:46.616877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4224179-661b-49df-be8e-b90fb6f6b058 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:46.617420 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4224179-661b-49df-be8e-b90fb6f6b058 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:46.617420 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4224179-661b-49df-be8e-b90fb6f6b058 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:46.618698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 600/1193] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:22:46.624547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a61e0-733f-413b-a470-f59537bae5ec None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:46.624948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a61e0-733f-413b-a470-f59537bae5ec None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:46.625096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a61e0-733f-413b-a470-f59537bae5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:46.643760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d11a61e0-733f-413b-a470-f59537bae5ec None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:22:46.644948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d11a61e0-733f-413b-a470-f59537bae5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:22:46.710153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 594/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:22:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:22:46.983638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4224179-661b-49df-be8e-b90fb6f6b058 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:47.031078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:47.083172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4224179-661b-49df-be8e-b90fb6f6b058 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:47.116001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077bc83-1ba5-40b2-b26e-82e478fe315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:47.116616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077bc83-1ba5-40b2-b26e-82e478fe315d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:47.116895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077bc83-1ba5-40b2-b26e-82e478fe315d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:47.117168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077bc83-1ba5-40b2-b26e-82e478fe315d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:47.128199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077bc83-1ba5-40b2-b26e-82e478fe315d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f077bc83-1ba5-40b2-b26e-82e478fe315d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:22:47.132915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:22:47.134074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:22:47.135010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 601/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:22:47.140583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a61e0-733f-413b-a470-f59537bae5ec None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:47.230906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:47.237550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a61e0-733f-413b-a470-f59537bae5ec None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:47.272359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:47.272963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:47.273239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:47.273507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:47.274205 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:47.274507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:47.275944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:47.283685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 595/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:22:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:47.289718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077bc83-1ba5-40b2-b26e-82e478fe315d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:47.387635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077bc83-1ba5-40b2-b26e-82e478fe315d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:47.394239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:47.419858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423df87e-48f7-48d2-8fd3-dfb23ccbe78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:47.420474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423df87e-48f7-48d2-8fd3-dfb23ccbe78b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:47.420752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423df87e-48f7-48d2-8fd3-dfb23ccbe78b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:47.421020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423df87e-48f7-48d2-8fd3-dfb23ccbe78b None admin] PATH_INFO: `/v3/users/190f12904f5e4669a487b92a5a229687` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:47.422228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423df87e-48f7-48d2-8fd3-dfb23ccbe78b None admin] RBAC: Authorizing `identity:get_user(user_id=190f12904f5e4669a487b92a5a229687)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:47.423642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423df87e-48f7-48d2-8fd3-dfb23ccbe78b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:47.425265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 602/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 22 14:22:47 2022] GET /identity/v3/users/190f12904f5e4669a487b92a5a229687 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:47.430992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:47.532456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f94c3-59f4-4055-a1bf-fbac1cfe57e8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:47.565544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093b269-0561-4d6b-8900-e8c970d70c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:47.566169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b269-0561-4d6b-8900-e8c970d70c23 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:47.566445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b269-0561-4d6b-8900-e8c970d70c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:47.566709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b269-0561-4d6b-8900-e8c970d70c23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:47.591450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:47.633563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093b269-0561-4d6b-8900-e8c970d70c23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:47.635039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093b269-0561-4d6b-8900-e8c970d70c23 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:47.731356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 596/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:22:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:22:47.738479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423df87e-48f7-48d2-8fd3-dfb23ccbe78b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:47.837070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423df87e-48f7-48d2-8fd3-dfb23ccbe78b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:47.870992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d288d88-7590-4b8c-9c43-0ac09880d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:47.871615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d288d88-7590-4b8c-9c43-0ac09880d913 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:47.871894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d288d88-7590-4b8c-9c43-0ac09880d913 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:47.872166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d288d88-7590-4b8c-9c43-0ac09880d913 None admin] PATH_INFO: `/v3/projects/3057d6f9cfde4b719bcf402023245274` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:47.873290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d288d88-7590-4b8c-9c43-0ac09880d913 None admin] RBAC: Authorizing `identity:get_project(project_id=3057d6f9cfde4b719bcf402023245274)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:47.874745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d288d88-7590-4b8c-9c43-0ac09880d913 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:47.876369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 603/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 22 14:22:47 2022] GET /identity/v3/projects/3057d6f9cfde4b719bcf402023245274 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:47.882572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093b269-0561-4d6b-8900-e8c970d70c23 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:22:47.937824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:47.993197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093b269-0561-4d6b-8900-e8c970d70c23 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:22:48.026733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3db38-484c-4db5-806d-3489c5096ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:22:48.027342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3db38-484c-4db5-806d-3489c5096ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:22:48.027618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3db38-484c-4db5-806d-3489c5096ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:22:48.027881 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3db38-484c-4db5-806d-3489c5096ff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:22:48.028596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3db38-484c-4db5-806d-3489c5096ff2 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=3057d6f9cfde4b719bcf402023245274, user.id=190f12904f5e4669a487b92a5a229687) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:22:48.028897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3db38-484c-4db5-806d-3489c5096ff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:22:48.030328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3db38-484c-4db5-806d-3489c5096ff2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:22:48.035853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 597/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:22:47 2022] GET /identity/v3/role_assignments?user.id=190f12904f5e4669a487b92a5a229687&scope.project.id=3057d6f9cfde4b719bcf402023245274&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:22:57.865935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=79 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:22:58.033376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=40 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:03.721538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdace46-a727-44e5-93d6-bcaa5833c578 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:03.722121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdace46-a727-44e5-93d6-bcaa5833c578 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:03.722121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdace46-a727-44e5-93d6-bcaa5833c578 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:03.723462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 604/1201] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:03.728974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1956-973e-42c0-a70c-bd2e5bb3d9eb None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:03.729405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1956-973e-42c0-a70c-bd2e5bb3d9eb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:03.729507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1956-973e-42c0-a70c-bd2e5bb3d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:03.747578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-258e1956-973e-42c0-a70c-bd2e5bb3d9eb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:03.749425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-258e1956-973e-42c0-a70c-bd2e5bb3d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:03.816411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 598/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:04.095014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdace46-a727-44e5-93d6-bcaa5833c578 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:04.195816 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdace46-a727-44e5-93d6-bcaa5833c578 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:04.229822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:04.230478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:04.230752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:04.231019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:04.243280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:04.244100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:04.258922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:04.260161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:04.261245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:04.261245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:04.261245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:04.261245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 605/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:04.267440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1956-973e-42c0-a70c-bd2e5bb3d9eb None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:04.366747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1956-973e-42c0-a70c-bd2e5bb3d9eb None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:04.396944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:04.402908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcd7a3-88e0-45a1-a434-951a919a44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:04.403643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcd7a3-88e0-45a1-a434-951a919a44de None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:04.403923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcd7a3-88e0-45a1-a434-951a919a44de None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:04.404198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcd7a3-88e0-45a1-a434-951a919a44de None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:04.404848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcd7a3-88e0-45a1-a434-951a919a44de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:04.405256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcd7a3-88e0-45a1-a434-951a919a44de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:04.406670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcd7a3-88e0-45a1-a434-951a919a44de None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:04.418045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 599/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:04.423996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:04.477419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:04.525099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b759e-f88b-4bab-bf2c-e0bf0582dbc6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:04.556930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f33cee-75af-4c29-a051-443b22190c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:04.557532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33cee-75af-4c29-a051-443b22190c1f None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:04.557806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33cee-75af-4c29-a051-443b22190c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:04.558105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f33cee-75af-4c29-a051-443b22190c1f None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:04.558808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f33cee-75af-4c29-a051-443b22190c1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:04.560278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f33cee-75af-4c29-a051-443b22190c1f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:04.646841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 606/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 22 14:24:04 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:24:06.879958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596cf3-8deb-4795-8206-71e3ba955136 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:06.880490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596cf3-8deb-4795-8206-71e3ba955136 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:06.880490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93596cf3-8deb-4795-8206-71e3ba955136 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:06.881806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 600/1206] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:06.886977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f752c0-3507-4344-9c84-a78f687afa6f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:06.888925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f752c0-3507-4344-9c84-a78f687afa6f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:06.888925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f752c0-3507-4344-9c84-a78f687afa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:06.906244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-22f752c0-3507-4344-9c84-a78f687afa6f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:06.907454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-22f752c0-3507-4344-9c84-a78f687afa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:06.975609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 607/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:24:07.242296 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93596cf3-8deb-4795-8206-71e3ba955136 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:07.343002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93596cf3-8deb-4795-8206-71e3ba955136 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:07.376023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cfa7d-4d6c-44a9-bf91-d57a89596bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:07.376644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfa7d-4d6c-44a9-bf91-d57a89596bfb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:07.376924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfa7d-4d6c-44a9-bf91-d57a89596bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:07.377204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cfa7d-4d6c-44a9-bf91-d57a89596bfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:07.387596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cfa7d-4d6c-44a9-bf91-d57a89596bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ea8cfa7d-4d6c-44a9-bf91-d57a89596bfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:24:07.392980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:07.394342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:24:07.395640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:07.396536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 601/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:24:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:07.400101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f752c0-3507-4344-9c84-a78f687afa6f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:07.439956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:07.496220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f752c0-3507-4344-9c84-a78f687afa6f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:07.530323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:07.530867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:07.531141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:07.531505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:07.532160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:07.532459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:07.533815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:07.542339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 608/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:24:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:07.547540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cfa7d-4d6c-44a9-bf91-d57a89596bfb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:07.597411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:07.647044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cfa7d-4d6c-44a9-bf91-d57a89596bfb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:07.681326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:07.681953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:07.682362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:07.682688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:07.694098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:07.695629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:07.710044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:07.711270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:07.712514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:07.712514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:07.712514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:07.712514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 602/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:07.717085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:07.816239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:07.819295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b7dc4-7056-4a27-b5ca-fab42cf9d112 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:07.852185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:07.852838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:07.853114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:07.853378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:07.854043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:07.854345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:07.855781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:07.867758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 609/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:24:07.874381 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:07.974363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a12cf-652e-48d0-9a75-fda3c00cb7fc None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:07.975920 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:08.010487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:08.011146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:08.011424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:08.011715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:08.019304 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:08.020732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:24:08.032234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:08.033387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:08.034486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 603/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:08.039551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:08.137337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6d5eb-8a4a-4cc5-8cf2-316102bac3f8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:08.170018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:08.171226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:08.171502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:08.171772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:08.172495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:08.172799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:08.174236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:08.191600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 610/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 22 14:24:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:08.197514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:08.302829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f0081-1114-4388-8da1-efe2cc9b0886 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:08.336939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7eecb-a4c3-429e-a8ec-f31b6d5f38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:08.337523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7eecb-a4c3-429e-a8ec-f31b6d5f38aa None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:08.337795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7eecb-a4c3-429e-a8ec-f31b6d5f38aa None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:08.338091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7eecb-a4c3-429e-a8ec-f31b6d5f38aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:08.367857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:08.405808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7eecb-a4c3-429e-a8ec-f31b6d5f38aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:08.407218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7eecb-a4c3-429e-a8ec-f31b6d5f38aa None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:08.507095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 604/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:24:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:24:08.513291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:08.533313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:08.615135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20390d7f-1a00-45f6-968d-040478e4b15f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:08.654395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:08.655058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:08.655499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:08.655770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:08.666280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:08.667743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:08.684235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:08.685453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:08.688204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:08.688204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:08.688204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:08.688204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 611/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:08.691958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7eecb-a4c3-429e-a8ec-f31b6d5f38aa None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:08.756551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:08.795731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7eecb-a4c3-429e-a8ec-f31b6d5f38aa None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:08.829993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:08.830611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:08.830889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:08.831159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:08.831837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:08.832213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:08.833674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:08.845514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 605/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:08.851556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:08.922936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:08.954137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0077b61-dd50-45d5-b661-23463d4d238f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:08.989535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:08.990428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:08.990699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:08.990961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:08.999108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:09.000525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:24:09.011591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:09.012710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:09.013830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 612/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:09.018698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:09.120902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247dc2d-15f3-4deb-af16-9fe1c7bb6897 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:09.143341 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:09.155184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae22b6-c8f4-4367-a942-544bfbafeb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:09.155801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae22b6-c8f4-4367-a942-544bfbafeb5a None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:09.156081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae22b6-c8f4-4367-a942-544bfbafeb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:09.156352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae22b6-c8f4-4367-a942-544bfbafeb5a None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:09.157043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae22b6-c8f4-4367-a942-544bfbafeb5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:09.157351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae22b6-c8f4-4367-a942-544bfbafeb5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:09.158811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae22b6-c8f4-4367-a942-544bfbafeb5a None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:09.171122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 606/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:09.177408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:09.279587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c653e-0f1b-4741-a0ab-7953b9760649 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:09.307790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:09.316616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c193908-9dac-4aab-be04-106853e1efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:09.317220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193908-9dac-4aab-be04-106853e1efb6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:09.317495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193908-9dac-4aab-be04-106853e1efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:09.317769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c193908-9dac-4aab-be04-106853e1efb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:09.318522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c193908-9dac-4aab-be04-106853e1efb6 None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=47cdb10124184914a81a87ae3173b8a4) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:09.318825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c193908-9dac-4aab-be04-106853e1efb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:09.320272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c193908-9dac-4aab-be04-106853e1efb6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:09.325699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 613/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:24:09 2022] GET /identity/v3/role_assignments?user.id=47cdb10124184914a81a87ae3173b8a4&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:11.461947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4379db-790f-4633-919e-5686bf5e720a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:11.462531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4379db-790f-4633-919e-5686bf5e720a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:11.462531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4379db-790f-4633-919e-5686bf5e720a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:11.463853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 607/1220] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:11.469040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e1ce6-7d2a-4a91-8874-9fde79451dd6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:11.469423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e1ce6-7d2a-4a91-8874-9fde79451dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:11.469593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e1ce6-7d2a-4a91-8874-9fde79451dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:11.488239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-891e1ce6-7d2a-4a91-8874-9fde79451dd6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:11.489412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-891e1ce6-7d2a-4a91-8874-9fde79451dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:11.553422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 614/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:11.820997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4379db-790f-4633-919e-5686bf5e720a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:11.922362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4379db-790f-4633-919e-5686bf5e720a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:11.956043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fa8cb-0eea-4fd3-a3ae-60cc3cedfdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:11.956669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa8cb-0eea-4fd3-a3ae-60cc3cedfdcb None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:11.956947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa8cb-0eea-4fd3-a3ae-60cc3cedfdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:11.957216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa8cb-0eea-4fd3-a3ae-60cc3cedfdcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:11.967118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fa8cb-0eea-4fd3-a3ae-60cc3cedfdcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-fe2fa8cb-0eea-4fd3-a3ae-60cc3cedfdcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:24:11.972336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:11.973425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:11.974382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 608/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:24:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:11.979469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e1ce6-7d2a-4a91-8874-9fde79451dd6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:12.075254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e1ce6-7d2a-4a91-8874-9fde79451dd6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:12.099085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:12.110093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:12.110698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:12.110977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:12.111250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:12.111913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:12.112214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:12.113575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:12.121315 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 615/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:12.127897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fa8cb-0eea-4fd3-a3ae-60cc3cedfdcb None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:12.173951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:12.230229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fa8cb-0eea-4fd3-a3ae-60cc3cedfdcb None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:12.265533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:12.266185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:12.266464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:12.266734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:12.276401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:12.277834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:12.292026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:12.293511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:12.295161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:12.295161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:12.295161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:12.295161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 609/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:12.299701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:12.402202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2f0f4-b100-498d-8033-fc715b9ff560 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:12.435801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:12.437035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:12.437312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:12.437585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:12.438352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:12.438658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:12.440018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:12.451781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 616/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:12.457789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:12.552157 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:12.558698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2204130-c25f-4735-9a7a-0c5620e7d852 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:12.590422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:12.591050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:12.591949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:12.591949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:12.599822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:12.601257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:24:12.612871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:12.613960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:12.614957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 610/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:12.619962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:12.667530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:12.722972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139242-b200-47ba-84db-2401f7fa6e34 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:12.759542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:12.760174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:12.760449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:12.760713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:12.761429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:12.761725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:12.763146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:12.780567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 617/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 22 14:24:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:12.786720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:12.893062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126069c-987c-4c8e-ac7b-2d0fd69a969d None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:12.932910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:12.933468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:12.933751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:12.934055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:12.947388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:12.948850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:12.964368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:12.965598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:12.966561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:12.966561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:12.966561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:12.966561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 611/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:12.972552 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:13.086286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50391e9-7814-438b-8269-04ab46941074 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:13.088720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:13.121114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:13.121717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:13.122018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:13.122296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:13.122936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:13.123238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:13.124824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:13.135857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 618/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:13.142656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:13.151882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:13.241430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b6db5-eec3-4250-97ce-3913d9c151a8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:13.276188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:13.276807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:13.277080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:13.277437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:13.285158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:13.286725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:24:13.298021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:13.299143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:13.300295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 612/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:13.305091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:13.420482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e953f39-d559-487d-a163-4ba7fea7d20e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:13.458185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea5754-d748-458d-88c5-0b3f845f6f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:13.458820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea5754-d748-458d-88c5-0b3f845f6f63 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:13.459095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea5754-d748-458d-88c5-0b3f845f6f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:13.459362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea5754-d748-458d-88c5-0b3f845f6f63 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:13.460063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea5754-d748-458d-88c5-0b3f845f6f63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:13.460359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea5754-d748-458d-88c5-0b3f845f6f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:13.461819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea5754-d748-458d-88c5-0b3f845f6f63 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:13.475445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 619/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:13.481580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:13.555543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:13.594200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58a77-8e9e-4320-8945-51bc0998083b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:13.633373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28122316-b0af-4b59-9448-aefcdeaff405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:13.634110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122316-b0af-4b59-9448-aefcdeaff405 None admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:13.634616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122316-b0af-4b59-9448-aefcdeaff405 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:13.634911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122316-b0af-4b59-9448-aefcdeaff405 None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/47cdb10124184914a81a87ae3173b8a4/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:13.654654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28122316-b0af-4b59-9448-aefcdeaff405 None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=47cdb10124184914a81a87ae3173b8a4, role_id=ec7a3b5dd84b4d68bde1443f1c0b3ca9)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:13.657300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28122316-b0af-4b59-9448-aefcdeaff405 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:13.776919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 613/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:24:13 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/47cdb10124184914a81a87ae3173b8a4/roles/ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:24:15.934283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874268c-0260-4028-a64f-8eeced099012 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:15.934890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874268c-0260-4028-a64f-8eeced099012 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:15.934890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874268c-0260-4028-a64f-8eeced099012 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:15.936242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 620/1233] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:15.941835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed011d44-940e-4d00-b151-a6290adea68f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:15.942673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed011d44-940e-4d00-b151-a6290adea68f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:15.942947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed011d44-940e-4d00-b151-a6290adea68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:15.961189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ed011d44-940e-4d00-b151-a6290adea68f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:15.962410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ed011d44-940e-4d00-b151-a6290adea68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:16.032693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 614/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:16.302836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874268c-0260-4028-a64f-8eeced099012 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:16.330054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:16.409944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874268c-0260-4028-a64f-8eeced099012 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:16.444428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db592e5-7a4b-4444-9760-1792f48fb857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:16.445056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db592e5-7a4b-4444-9760-1792f48fb857 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:16.445337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db592e5-7a4b-4444-9760-1792f48fb857 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:16.445610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db592e5-7a4b-4444-9760-1792f48fb857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:16.457278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db592e5-7a4b-4444-9760-1792f48fb857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8db592e5-7a4b-4444-9760-1792f48fb857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:24:16.462077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:16.463246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:16.464328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 621/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 22 14:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:16.469922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed011d44-940e-4d00-b151-a6290adea68f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:16.516943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:16.568766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed011d44-940e-4d00-b151-a6290adea68f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:16.603160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:16.603761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:16.604074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:16.604344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:16.605003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:16.605302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:16.606688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:16.614909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 615/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 22 14:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:16.620985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db592e5-7a4b-4444-9760-1792f48fb857 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:16.708905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:16.725295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db592e5-7a4b-4444-9760-1792f48fb857 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:16.759947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:16.767196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:16.767196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:16.767196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:16.771745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:16.773181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:16.788572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:16.789623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:16.790606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:16.790606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:16.790606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:16.790606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 622/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:16.796509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:16.902329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78f650-2f44-4120-99c4-152bd81fcc59 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:16.911942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:16.936851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:16.937459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:16.937740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:16.938036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:16.938685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:16.938988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:16.940357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:16.952632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 616/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:16.958724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:17.066454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87016a72-2032-4aef-9596-f94741f9a97f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:17.106671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:17.107297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:17.107611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:17.107883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:17.110610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:17.115774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:17.117197 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:24:17.129384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:17.134807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:17.135896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 623/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:17.136663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:17.234807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c9a97-a837-4fbb-a536-5938e584540b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:17.271237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:17.271857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:17.272135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:17.272404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:17.273140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:17.273444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:17.274906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:17.293266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 617/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 22 14:24:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:17.299712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:17.404166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338416-9e03-4e83-85cd-8380038ecbf2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:17.439981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0a3a-6512-49f5-a5fb-e2311c0d5710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:17.443121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0a3a-6512-49f5-a5fb-e2311c0d5710 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:17.443121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0a3a-6512-49f5-a5fb-e2311c0d5710 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:17.443121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0a3a-6512-49f5-a5fb-e2311c0d5710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:17.504924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:17.511532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b0a3a-6512-49f5-a5fb-e2311c0d5710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:17.513016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b0a3a-6512-49f5-a5fb-e2311c0d5710 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:17.612775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 624/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:24:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:24:17.618707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:17.647935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:17.721760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b854c-bb3b-4fbc-81aa-6f8e1eb02e3e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:17.756363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:17.756997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:17.757344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:17.757636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:17.768225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:17.769712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:17.786183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:17.787399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:17.788357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:17.788357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:17.788357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:17.788357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 618/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:17.793384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0a3a-6512-49f5-a5fb-e2311c0d5710 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:17.890901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:17.896699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0a3a-6512-49f5-a5fb-e2311c0d5710 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:17.931901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:17.932510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:17.932788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:17.933059 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:17.933708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:17.934035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:17.935404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:17.948615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 625/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:17.955367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:18.036145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:18.057417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47484035-4744-452f-a39e-e9a707e4ce3c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:18.092036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:18.092806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:18.093082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:18.093351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:18.100270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:18.101691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:24:18.113041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:18.114204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:18.115312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 619/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:24:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:18.120280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:18.220283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6ac36-6039-4dde-a438-0aed7bcc898e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:18.255314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5aff3-31a7-4865-8b74-5a63355f8afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:18.259671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5aff3-31a7-4865-8b74-5a63355f8afc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:18.259671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5aff3-31a7-4865-8b74-5a63355f8afc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:18.259671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5aff3-31a7-4865-8b74-5a63355f8afc None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:18.259671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5aff3-31a7-4865-8b74-5a63355f8afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:18.259671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5aff3-31a7-4865-8b74-5a63355f8afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:18.259671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5aff3-31a7-4865-8b74-5a63355f8afc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:18.271786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 626/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:18.277885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:18.392815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b5ed-b6f2-45d6-9bea-be58c2923590 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:18.426730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999af4-df15-4688-8e1f-8463cfd66de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:18.427373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999af4-df15-4688-8e1f-8463cfd66de4 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:18.427646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999af4-df15-4688-8e1f-8463cfd66de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:18.427917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999af4-df15-4688-8e1f-8463cfd66de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:18.428650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999af4-df15-4688-8e1f-8463cfd66de4 None admin] RBAC: Adding query filter params (role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=47cdb10124184914a81a87ae3173b8a4) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:18.428955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999af4-df15-4688-8e1f-8463cfd66de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:18.430407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999af4-df15-4688-8e1f-8463cfd66de4 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:18.436417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 620/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:24:18 2022] GET /identity/v3/role_assignments?user.id=47cdb10124184914a81a87ae3173b8a4&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=ec7a3b5dd84b4d68bde1443f1c0b3ca9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:20.684067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cbf34-beaa-47dd-ade9-250c25a83ba9 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:20.684596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cbf34-beaa-47dd-ade9-250c25a83ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:20.684596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cbf34-beaa-47dd-ade9-250c25a83ba9 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:20.686270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 627/1247] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:20.691460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb5e3f-eb19-4804-95a1-9ef4e1f6bf6f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:20.691898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb5e3f-eb19-4804-95a1-9ef4e1f6bf6f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:20.691989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb5e3f-eb19-4804-95a1-9ef4e1f6bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:20.698480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:20.712675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e2bb5e3f-eb19-4804-95a1-9ef4e1f6bf6f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:20.713903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e2bb5e3f-eb19-4804-95a1-9ef4e1f6bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:20.781778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 621/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:21.054806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cbf34-beaa-47dd-ade9-250c25a83ba9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:21.073935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:21.164928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cbf34-beaa-47dd-ade9-250c25a83ba9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:21.199963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342746ae-a2cd-4652-85ac-6f296c055b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:21.200595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342746ae-a2cd-4652-85ac-6f296c055b34 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:21.200878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342746ae-a2cd-4652-85ac-6f296c055b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:21.201175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342746ae-a2cd-4652-85ac-6f296c055b34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:21.211594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342746ae-a2cd-4652-85ac-6f296c055b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-342746ae-a2cd-4652-85ac-6f296c055b34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:24:21.216511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:21.217640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:21.218594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 628/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:21.224259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb5e3f-eb19-4804-95a1-9ef4e1f6bf6f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:21.349573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb5e3f-eb19-4804-95a1-9ef4e1f6bf6f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:21.381048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:21.386041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:21.386719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:21.386973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:21.387245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:21.387917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:21.388219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:21.389717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:21.398377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 622/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:21.404279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342746ae-a2cd-4652-85ac-6f296c055b34 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:21.483324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:21.506696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342746ae-a2cd-4652-85ac-6f296c055b34 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:21.540113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:21.540740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:21.541016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:21.541285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:21.552637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:21.554632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:21.569207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:21.570698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:21.571885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:21.571885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:21.571885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:21.571885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 629/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:21.576333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:21.691120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f59213-e9d4-44ff-b929-be6a05d7259c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:21.730745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:21.731469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:21.731621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:21.731890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:21.733150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:21.733449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:21.734852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:21.746846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 623/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:21.752595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:21.852971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fae45-c17c-4ea8-a286-65d64b4f25bf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:21.879208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:21.886858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:21.887477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:21.887754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:21.888025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:21.895385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:21.896793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:24:21.908955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:21.910159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:21.911538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 630/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:21.915859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:21.972096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:22.015859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace90c3-7475-4be3-a576-b0a80e6efe4b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:22.048824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:22.049472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:22.049784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:22.050093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:22.050814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:22.051147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:22.052572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:22.069620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 624/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 22 14:24:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:22.075310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:22.175784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8fd9-c97c-4080-9d50-eeae252620c4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:22.209260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe0234-68c8-4f13-a804-5e33864b2cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:22.209860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0234-68c8-4f13-a804-5e33864b2cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:22.210168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0234-68c8-4f13-a804-5e33864b2cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:22.210447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe0234-68c8-4f13-a804-5e33864b2cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:22.267292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:22.280672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe0234-68c8-4f13-a804-5e33864b2cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:22.282172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe0234-68c8-4f13-a804-5e33864b2cf8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:22.381841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 631/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:24:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:24:22.387778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:22.493798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3841c-8fec-4bd7-93af-0403636ccf44 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:22.507502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:22.528873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:22.530061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:22.530061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:22.530301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:22.540684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:22.545406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:22.556480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:22.557585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:22.558561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:22.558561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:22.558561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:22.558561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 625/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:22.563987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe0234-68c8-4f13-a804-5e33864b2cf8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:22.652836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:22.664530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe0234-68c8-4f13-a804-5e33864b2cf8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:22.702573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:22.703173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:22.703450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:22.703721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:22.704355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:22.704653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:22.706044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:22.716895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 632/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:22.723016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:22.826612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1800c-cd8f-4755-a68f-6dc8ff32ecbe None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:22.861562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:22.861562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:22.861894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:22.861894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:22.869456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:22.871015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:24:22.885441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:22.886498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:22.887467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 626/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:22.895642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:23.011464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2070f-c508-40ae-b8fa-0b5ac15f72c0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:23.053866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820765d-1365-4cca-9592-97bdf14551a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:23.054503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820765d-1365-4cca-9592-97bdf14551a6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:23.054860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820765d-1365-4cca-9592-97bdf14551a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:23.055309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820765d-1365-4cca-9592-97bdf14551a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:23.056530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820765d-1365-4cca-9592-97bdf14551a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:23.057039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820765d-1365-4cca-9592-97bdf14551a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:23.058868 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820765d-1365-4cca-9592-97bdf14551a6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:23.074374 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 633/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:23.081157 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:23.108209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:23.184715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b074f5d-f79c-4581-bb0f-92b94bc336ff None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:23.228510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a747c98-7b6f-4357-a170-7718e2fcab50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:23.229561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747c98-7b6f-4357-a170-7718e2fcab50 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:23.230107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747c98-7b6f-4357-a170-7718e2fcab50 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:23.230392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747c98-7b6f-4357-a170-7718e2fcab50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:23.231143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a747c98-7b6f-4357-a170-7718e2fcab50 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=47cdb10124184914a81a87ae3173b8a4) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:23.231453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a747c98-7b6f-4357-a170-7718e2fcab50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:23.233587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a747c98-7b6f-4357-a170-7718e2fcab50 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:23.240605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 627/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:24:23 2022] GET /identity/v3/role_assignments?user.id=47cdb10124184914a81a87ae3173b8a4&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:25.439832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd72fcc-c7de-4272-96b9-0fcf510be654 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:25.440494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd72fcc-c7de-4272-96b9-0fcf510be654 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:25.440494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd72fcc-c7de-4272-96b9-0fcf510be654 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:25.441780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 634/1261] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:25.447268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f1876-e17e-47a9-b012-5b553975c734 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:25.447799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f1876-e17e-47a9-b012-5b553975c734 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:25.451890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f1876-e17e-47a9-b012-5b553975c734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:25.466389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-bf1f1876-e17e-47a9-b012-5b553975c734 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:25.468161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bf1f1876-e17e-47a9-b012-5b553975c734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:25.540146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 628/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:25.813704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd72fcc-c7de-4272-96b9-0fcf510be654 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:25.824468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:25.914963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd72fcc-c7de-4272-96b9-0fcf510be654 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:25.947977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9917028-dbbe-4da3-8490-8d09d103e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:25.948599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9917028-dbbe-4da3-8490-8d09d103e087 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:25.948877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9917028-dbbe-4da3-8490-8d09d103e087 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:25.949147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9917028-dbbe-4da3-8490-8d09d103e087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:25.959820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9917028-dbbe-4da3-8490-8d09d103e087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f9917028-dbbe-4da3-8490-8d09d103e087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:24:25.965118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:25.966353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:24:25.968520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:25.970573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 635/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:25.973243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f1876-e17e-47a9-b012-5b553975c734 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:25.992431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:26.074743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f1876-e17e-47a9-b012-5b553975c734 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:26.115149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:26.115766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:26.116047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:26.116325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:26.117007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:26.117312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:26.118763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:26.128580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 629/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:26.134523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9917028-dbbe-4da3-8490-8d09d103e087 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:26.202558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:26.235763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9917028-dbbe-4da3-8490-8d09d103e087 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:26.271229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:26.271866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:26.272143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:26.272412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:26.284163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:26.285617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:26.299469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:26.300672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:26.301629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:26.301629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:26.301629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:26.301629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 636/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:26.306513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:26.395626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:26.414060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe027e-e6be-495e-ab68-37d5f162078b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:26.451769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:26.452416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:26.452648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:26.452918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:26.453561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:26.453863 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:26.455249 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:26.466703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 630/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:26.472786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:26.573008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b09d1-1a3c-4f81-b7b0-3625cebcedbf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:26.593709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:26.607701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:26.608343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:26.608623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:26.608899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:26.616726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:26.618357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:24:26.630396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:26.635434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:26.636624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 637/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:26.637457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:26.739666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c89aa3-32de-4094-b2a6-580c508e7f7e None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:26.774052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:26.774655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:26.775000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:26.775274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:26.775996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:26.776302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:26.777719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:26.787072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:26.796956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 631/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 22 14:24:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:26.803080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:26.909465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9712-f0bf-4f02-8efd-e822df656ee2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:26.942980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:26.943604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:26.943882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:26.944154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:26.957679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:26.959171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:26.973450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:26.974685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:26.975694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:26.975694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:26.975694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:26.975694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 638/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 22 14:24:26.980362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:27.082700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e2d6a-ff58-4ed0-b483-2d9d9ff8d3a2 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:27.116651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:27.117305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:27.117630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:27.117907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:27.118584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:27.118891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:27.120260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:27.131945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 632/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:27.137768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:27.170645 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:27.242044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac51a40-622c-4697-bb9a-c9926607eddc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:27.276929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:27.277516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:27.277795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:27.278093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:27.284649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:27.286117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:24:27.297746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:27.298920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:27.300234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 639/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:27.304899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:27.365405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:27.406143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519101b-264a-4452-a595-172580f3e3a6 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:27.439463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af0577-0aad-4d53-8f52-f9147518f758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:27.440073 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0577-0aad-4d53-8f52-f9147518f758 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:27.440361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0577-0aad-4d53-8f52-f9147518f758 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:27.440634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0577-0aad-4d53-8f52-f9147518f758 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:27.441326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af0577-0aad-4d53-8f52-f9147518f758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:27.441629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af0577-0aad-4d53-8f52-f9147518f758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:27.443080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af0577-0aad-4d53-8f52-f9147518f758 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:27.455142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 633/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:27.463250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:27.555836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:27.564391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f73a55-3c8f-40e6-b978-9e0e7d206ba1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:27.597829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b8501-0b48-4787-bbf4-634fa415b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:27.598511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8501-0b48-4787-bbf4-634fa415b8aa None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:27.598791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8501-0b48-4787-bbf4-634fa415b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:27.599064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8501-0b48-4787-bbf4-634fa415b8aa None admin] PATH_INFO: `/v3/projects/28a284deafef4655839c517e7eee7ff6/users/47cdb10124184914a81a87ae3173b8a4/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:27.600954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b8501-0b48-4787-bbf4-634fa415b8aa None admin] RBAC: Authorizing `identity:create_grant(project_id=28a284deafef4655839c517e7eee7ff6, user_id=47cdb10124184914a81a87ae3173b8a4, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:27.602425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b8501-0b48-4787-bbf4-634fa415b8aa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:27.713466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 640/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 22 14:24:27 2022] PUT /identity/v3/projects/28a284deafef4655839c517e7eee7ff6/users/47cdb10124184914a81a87ae3173b8a4/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:24:29.875747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb8dd2-487f-40a1-a78c-c73ba2571a8a None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:29.876283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb8dd2-487f-40a1-a78c-c73ba2571a8a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:29.876283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb8dd2-487f-40a1-a78c-c73ba2571a8a None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:29.877607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 634/1274] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:29.882900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725517-d2b6-4942-af83-0907395b0129 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:29.883323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725517-d2b6-4942-af83-0907395b0129 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:29.883451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725517-d2b6-4942-af83-0907395b0129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:29.902591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-61725517-d2b6-4942-af83-0907395b0129 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:29.903786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-61725517-d2b6-4942-af83-0907395b0129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:29.974713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 641/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:30.250234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb8dd2-487f-40a1-a78c-c73ba2571a8a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:30.352975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb8dd2-487f-40a1-a78c-c73ba2571a8a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:30.371870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:30.389796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84092588-a709-4515-ab9d-1158b0c1d837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:30.390480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092588-a709-4515-ab9d-1158b0c1d837 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:30.390772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092588-a709-4515-ab9d-1158b0c1d837 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:30.391064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84092588-a709-4515-ab9d-1158b0c1d837 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:30.402139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84092588-a709-4515-ab9d-1158b0c1d837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-84092588-a709-4515-ab9d-1158b0c1d837 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 22 14:24:30.407750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:30.411506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:30.412387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 635/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 22 14:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:30.415316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725517-d2b6-4942-af83-0907395b0129 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:30.499976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:30.518274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725517-d2b6-4942-af83-0907395b0129 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:30.552079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:30.552674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:30.552949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:30.553217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:30.553869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:30.554202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:30.555563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:30.563837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 642/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 22 14:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:30.570054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84092588-a709-4515-ab9d-1158b0c1d837 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:30.671192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84092588-a709-4515-ab9d-1158b0c1d837 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:30.705909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:30.706561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:30.706857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:30.707119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:30.717474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:30.723160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:30.733693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:30.734839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:30.735935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:30.735935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:30.735935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:30.735935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 636/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:30.740712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:30.843754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaef665-2512-4140-a167-b9c41d8a3a81 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:30.877863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:30.878493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:30.878772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:30.879043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:30.879689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:30.880007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:30.881387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:30.894170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 643/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:30.900267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:30.932831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:31.005792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7bf97-396c-4cc3-86e9-e2af5ed2d57b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:31.040960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:31.041595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:31.041873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:31.042171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:31.050542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:31.052107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 22 14:24:31.064230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:31.065565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:31.066968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 637/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:31.071466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:31.080277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:31.173750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a792fa-3d0a-47db-971f-985635ef8003 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:31.208497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:31.209106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:31.209432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:31.209701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:31.210466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:31.210768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:31.212186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:31.230765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 644/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 22 14:24:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:24:31.237196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:31.326360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:31.335690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720ba44-7715-467e-b1d3-a5eec71ff616 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:31.368884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f2cb0-678a-4093-a5a0-6f1480a82fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:31.369471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2cb0-678a-4093-a5a0-6f1480a82fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:31.369755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2cb0-678a-4093-a5a0-6f1480a82fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:31.370058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f2cb0-678a-4093-a5a0-6f1480a82fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:31.436184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f2cb0-678a-4093-a5a0-6f1480a82fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:31.437607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f2cb0-678a-4093-a5a0-6f1480a82fa8 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:31.526037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:31.537224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 638/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 22 14:24:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 22 14:24:31.543649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:31.606321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:31.644584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8f5ac-c91a-4a1c-80a2-3dccb149f23f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:31.678955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:31.679581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:31.679856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:31.680122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:31.690626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:31.692021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 22 14:24:31.708099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:31.709311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 22 14:24:31.710424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 22 14:24:31.710424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 22 14:24:31.710424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:31.714030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 645/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:31.715132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f2cb0-678a-4093-a5a0-6f1480a82fa8 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:31.815294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f2cb0-678a-4093-a5a0-6f1480a82fa8 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:31.848490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:31.849094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:31.849371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:31.849640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:31.850309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:31.850607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:31.851960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:31.863920 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 639/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 22 14:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:31.869910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:31.972375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069013e-0170-4bf9-a718-fff965515c75 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:31.987351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:32.009006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:32.009891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:32.010382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:32.010867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:32.021944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:32.023560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 22 14:24:32.036954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:32.038451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 22 14:24:32.039824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 646/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 22 14:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:32.045368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:32.097618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:32.148053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2a35-6218-45a6-ac3a-6a04933b457b None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:32.181568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea8d6b-0b2f-4a51-97f6-28fa638512e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:32.182192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea8d6b-0b2f-4a51-97f6-28fa638512e6 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:32.182477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea8d6b-0b2f-4a51-97f6-28fa638512e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:32.182745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea8d6b-0b2f-4a51-97f6-28fa638512e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:32.183431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea8d6b-0b2f-4a51-97f6-28fa638512e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:32.183729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea8d6b-0b2f-4a51-97f6-28fa638512e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:32.185176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea8d6b-0b2f-4a51-97f6-28fa638512e6 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:32.197538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 640/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 22 14:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:32.204224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:32.316085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d520b0-4fbc-46c8-9b97-ab605a288ce4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:32.351044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d4347-bbdc-428d-9ae6-02240c020a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:32.351648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4347-bbdc-428d-9ae6-02240c020a73 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:32.351925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4347-bbdc-428d-9ae6-02240c020a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:32.352219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4347-bbdc-428d-9ae6-02240c020a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:32.352925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d4347-bbdc-428d-9ae6-02240c020a73 None admin] RBAC: Adding query filter params (role.id=f611d3669a1a4242b954f7626bfcbe75, scope.project.id=28a284deafef4655839c517e7eee7ff6, user.id=47cdb10124184914a81a87ae3173b8a4) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:32.353233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d4347-bbdc-428d-9ae6-02240c020a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:32.354683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d4347-bbdc-428d-9ae6-02240c020a73 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:32.360996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 647/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 22 14:24:32 2022] GET /identity/v3/role_assignments?user.id=47cdb10124184914a81a87ae3173b8a4&scope.project.id=28a284deafef4655839c517e7eee7ff6&role.id=f611d3669a1a4242b954f7626bfcbe75 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:34.582745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90b8c-1266-49f8-8bcb-2a7382ef03a1 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:34.583255 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90b8c-1266-49f8-8bcb-2a7382ef03a1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:34.583255 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90b8c-1266-49f8-8bcb-2a7382ef03a1 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:34.584512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 641/1288] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:34.590138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920629-178e-4999-b903-469a39dc774c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:34.590570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920629-178e-4999-b903-469a39dc774c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:34.590693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920629-178e-4999-b903-469a39dc774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:34.609270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2c920629-178e-4999-b903-469a39dc774c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:34.610521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2c920629-178e-4999-b903-469a39dc774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:34.642661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:34.679376 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 648/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 22 14:24:34.952757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f90b8c-1266-49f8-8bcb-2a7382ef03a1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:35.053303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f90b8c-1266-49f8-8bcb-2a7382ef03a1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:35.063941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:35.086248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:35.086865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:35.087138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:35.087404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:35.087973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:35.089343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:35.098722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:35.099922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:35.100791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 642/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:24:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:35.106517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920629-178e-4999-b903-469a39dc774c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:35.205885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920629-178e-4999-b903-469a39dc774c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:35.240093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bd830-f8c2-4b75-945e-d2ad2ace4cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:35.240702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bd830-f8c2-4b75-945e-d2ad2ace4cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:35.240975 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bd830-f8c2-4b75-945e-d2ad2ace4cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:35.241242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bd830-f8c2-4b75-945e-d2ad2ace4cf9 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:35.241866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bd830-f8c2-4b75-945e-d2ad2ace4cf9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:35.242198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bd830-f8c2-4b75-945e-d2ad2ace4cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:35.243537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bd830-f8c2-4b75-945e-d2ad2ace4cf9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:35.248746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 649/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Sep 22 14:24:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:35.254516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:35.351997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192d967-91ee-4ab6-8c8a-686ec17eef75 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:35.385187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b249fc-d9a7-401f-854c-62e5bf4ccb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:35.385790 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b249fc-d9a7-401f-854c-62e5bf4ccb30 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:35.386096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b249fc-d9a7-401f-854c-62e5bf4ccb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:35.386373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b249fc-d9a7-401f-854c-62e5bf4ccb30 None admin] PATH_INFO: `/v3/services` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:35.387004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b249fc-d9a7-401f-854c-62e5bf4ccb30 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:35.387307 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b249fc-d9a7-401f-854c-62e5bf4ccb30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:35.389110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b249fc-d9a7-401f-854c-62e5bf4ccb30 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:35.393468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 643/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Sep 22 14:24:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:37.600221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452415-7ba6-4f59-9e19-234a2b4df73e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:37.600849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452415-7ba6-4f59-9e19-234a2b4df73e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:37.600849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452415-7ba6-4f59-9e19-234a2b4df73e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:37.602010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 650/1293] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:37.608185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878623f-ad84-48ea-b4c8-b1654adaedc8 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:37.608615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878623f-ad84-48ea-b4c8-b1654adaedc8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:37.608723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878623f-ad84-48ea-b4c8-b1654adaedc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:37.627467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f878623f-ad84-48ea-b4c8-b1654adaedc8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:37.634551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f878623f-ad84-48ea-b4c8-b1654adaedc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:37.660343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:37.696896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 644/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:37.975532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6452415-7ba6-4f59-9e19-234a2b4df73e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:38.007178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:38.080354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6452415-7ba6-4f59-9e19-234a2b4df73e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:38.115012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1d275-f1db-4882-bac8-72470ee4e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:38.115665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1d275-f1db-4882-bac8-72470ee4e9ed None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:38.115947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1d275-f1db-4882-bac8-72470ee4e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:38.116223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1d275-f1db-4882-bac8-72470ee4e9ed None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:38.116886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1d275-f1db-4882-bac8-72470ee4e9ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:38.118331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1d275-f1db-4882-bac8-72470ee4e9ed None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:38.211281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 651/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 22 14:24:37 2022] POST /identity/v3/services => generated 246 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:24:40.460315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350522-0a81-4c3c-9962-9042710f9f27 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:40.461220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350522-0a81-4c3c-9962-9042710f9f27 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:40.461220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350522-0a81-4c3c-9962-9042710f9f27 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:40.462759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 645/1296] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:40.468361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbe6c4-cf50-48bf-aeca-f77839fda61e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:40.468799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbe6c4-cf50-48bf-aeca-f77839fda61e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:40.468913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbe6c4-cf50-48bf-aeca-f77839fda61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:40.488715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c1cbe6c4-cf50-48bf-aeca-f77839fda61e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:40.489921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c1cbe6c4-cf50-48bf-aeca-f77839fda61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:40.564924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 652/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:40.831396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350522-0a81-4c3c-9962-9042710f9f27 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:40.937653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350522-0a81-4c3c-9962-9042710f9f27 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:40.971086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:40.971706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:40.971985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:40.972256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:40.972832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:40.974222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:40.983524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:40.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:40.985612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 646/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:24:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:40.990873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbe6c4-cf50-48bf-aeca-f77839fda61e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:41.010171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:41.090726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbe6c4-cf50-48bf-aeca-f77839fda61e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:41.124816 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:41.125417 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:41.125692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:41.125962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:41.126667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:41.126964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:41.128357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:41.133335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 653/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Sep 22 14:24:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:41.139682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:41.172619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:41.243045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c41c9-7db8-4eeb-a40c-68ad101fde57 None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:41.278946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740f97-6930-432a-a75e-e5e8120ac670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:41.279557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740f97-6930-432a-a75e-e5e8120ac670 None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:41.279833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740f97-6930-432a-a75e-e5e8120ac670 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:41.280106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740f97-6930-432a-a75e-e5e8120ac670 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:41.280810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740f97-6930-432a-a75e-e5e8120ac670 None admin] RBAC: Adding query filter params (interface=public, service_id=fbe36dad61be4b9a879c526f42452708, region_id=RegionOne) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:41.281114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740f97-6930-432a-a75e-e5e8120ac670 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:41.282510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740f97-6930-432a-a75e-e5e8120ac670 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:41.287455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 647/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 22 14:24:41 2022] GET /identity/v3/endpoints?service_id=fbe36dad61be4b9a879c526f42452708&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:24:41.293574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:41.377254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:41.395567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2103cb7-1930-4408-a14d-ec02c1767071 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:41.432752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7e113-8466-4704-9641-f9ed34f5c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:41.433348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e113-8466-4704-9641-f9ed34f5c113 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:41.433786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e113-8466-4704-9641-f9ed34f5c113 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:41.434086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e113-8466-4704-9641-f9ed34f5c113 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:41.435436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7e113-8466-4704-9641-f9ed34f5c113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:41.436853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7e113-8466-4704-9641-f9ed34f5c113 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:41.447671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 654/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 22 14:24:41 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:24:43.688080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63789ce-547f-45d7-8e84-5807cf5da232 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:43.688585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63789ce-547f-45d7-8e84-5807cf5da232 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:43.688585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63789ce-547f-45d7-8e84-5807cf5da232 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:43.689866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 648/1302] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:24:43.695184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749c28-05f9-4ee0-92b9-d53ab39b1ae6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:43.695600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749c28-05f9-4ee0-92b9-d53ab39b1ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:43.695737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33749c28-05f9-4ee0-92b9-d53ab39b1ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:43.714656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-33749c28-05f9-4ee0-92b9-d53ab39b1ae6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:24:43.715885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-33749c28-05f9-4ee0-92b9-d53ab39b1ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:24:43.785051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 655/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:24:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 22 14:24:44.077072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63789ce-547f-45d7-8e84-5807cf5da232 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:44.172035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:44.178740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63789ce-547f-45d7-8e84-5807cf5da232 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:44.212614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:44.213246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:44.213528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:44.213804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:44.214428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:44.218533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 22 14:24:44.224898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 22 14:24:44.226023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.get_or_create( Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application with Lock( Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self._enter() Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application return self.creator() Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application created_value = creator( Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: ERROR keystone.server.flask.application Sep 22 14:24:44.226996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 649/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 22 14:24:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 22 14:24:44.232418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33749c28-05f9-4ee0-92b9-d53ab39b1ae6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:44.309412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:44.333038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33749c28-05f9-4ee0-92b9-d53ab39b1ae6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:44.365771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968c9ee-3b2b-46db-9c0e-cb4b6e7550c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:44.366403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c9ee-3b2b-46db-9c0e-cb4b6e7550c2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:44.366680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c9ee-3b2b-46db-9c0e-cb4b6e7550c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:44.366946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968c9ee-3b2b-46db-9c0e-cb4b6e7550c2 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:44.367629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c9ee-3b2b-46db-9c0e-cb4b6e7550c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:24:44.368032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c9ee-3b2b-46db-9c0e-cb4b6e7550c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:44.369480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968c9ee-3b2b-46db-9c0e-cb4b6e7550c2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:44.374978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 656/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Sep 22 14:24:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:24:44.380727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:24:44.478944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05f574-7105-485a-bcf7-5aa414cbfa1c None admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:24:44.512557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c872c4-f8dc-4aab-b986-4644fb59c121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:24:44.513218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c872c4-f8dc-4aab-b986-4644fb59c121 None admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:24:44.513492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c872c4-f8dc-4aab-b986-4644fb59c121 None admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:24:44.513762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c872c4-f8dc-4aab-b986-4644fb59c121 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:24:44.514464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c872c4-f8dc-4aab-b986-4644fb59c121 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:24:44.515819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c872c4-f8dc-4aab-b986-4644fb59c121 None admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:24:44.601572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 650/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:24:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:24:54.461730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=30 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:24:54.596472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:06.527950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf142557-3715-431c-a020-60d630185356 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:06.528401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf142557-3715-431c-a020-60d630185356 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:06.528789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf142557-3715-431c-a020-60d630185356 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:06.536444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d3b14-1862-41f8-9e92-76959a5d211e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:06.536878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d3b14-1862-41f8-9e92-76959a5d211e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:06.537035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d3b14-1862-41f8-9e92-76959a5d211e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:06.542435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 657/1307] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:06 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:06.672899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c95d3b14-1862-41f8-9e92-76959a5d211e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:06.674795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c95d3b14-1862-41f8-9e92-76959a5d211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:06.818754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 651/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:31:07.112222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a11ff-8824-4083-b638-5e14116f1a97 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:07.112574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a11ff-8824-4083-b638-5e14116f1a97 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:07.112773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a11ff-8824-4083-b638-5e14116f1a97 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:07.114481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 658/1309] 10.222.0.16 () {54 vars in 964 bytes} [Thu Sep 22 14:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:07.123057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65f42-1eba-4ba1-bbfb-2894d3bd8ac7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:07.123687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65f42-1eba-4ba1-bbfb-2894d3bd8ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:07.124280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65f42-1eba-4ba1-bbfb-2894d3bd8ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:07.217744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3ed65f42-1eba-4ba1-bbfb-2894d3bd8ac7 None None] MFA Rules not processed for user `75252b7cba4943b2874983d1a83a9175`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:07.219027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3ed65f42-1eba-4ba1-bbfb-2894d3bd8ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:07.258544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:07.328610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 652/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Sep 22 14:31:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:07.339213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a11ff-8824-4083-b638-5e14116f1a97 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:07.341441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1c6a11ff-8824-4083-b638-5e14116f1a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:07.481377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a11ff-8824-4083-b638-5e14116f1a97 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:07.572225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbfec9-8ba1-4445-bf52-7876f128f610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:07.573718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbfec9-8ba1-4445-bf52-7876f128f610 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:07.574202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbfec9-8ba1-4445-bf52-7876f128f610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:07.574652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbfec9-8ba1-4445-bf52-7876f128f610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:07.576558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-29cbfec9-8ba1-4445-bf52-7876f128f610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:07.639766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:07.702838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbfec9-8ba1-4445-bf52-7876f128f610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:07.704794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbfec9-8ba1-4445-bf52-7876f128f610 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:07.726662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 659/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:10.339452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317dfc-bbf9-405b-951c-dc9a69e8c33f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:10.339985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317dfc-bbf9-405b-951c-dc9a69e8c33f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:10.339985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c317dfc-bbf9-405b-951c-dc9a69e8c33f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:10.341322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 653/1312] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:10.346512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce24d-ccd9-458a-9090-e817e69d7bd7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:10.346935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce24d-ccd9-458a-9090-e817e69d7bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:10.347064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce24d-ccd9-458a-9090-e817e69d7bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:10.429743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-70cce24d-ccd9-458a-9090-e817e69d7bd7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:10.430988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-70cce24d-ccd9-458a-9090-e817e69d7bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:10.527397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 660/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:10.812403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317dfc-bbf9-405b-951c-dc9a69e8c33f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:10.813951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7c317dfc-bbf9-405b-951c-dc9a69e8c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:10.917986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c317dfc-bbf9-405b-951c-dc9a69e8c33f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:10.990665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:10.993485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527924f-7d97-456d-88ac-b54109127b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:10.994127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527924f-7d97-456d-88ac-b54109127b66 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:10.994412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527924f-7d97-456d-88ac-b54109127b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:10.994684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527924f-7d97-456d-88ac-b54109127b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:10.996316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a527924f-7d97-456d-88ac-b54109127b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:11.107380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527924f-7d97-456d-88ac-b54109127b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:11.109037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527924f-7d97-456d-88ac-b54109127b66 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:11.127925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 654/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:13.963009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e2a2-f802-473e-ba45-0ed35ea07e87 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:13.963603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e2a2-f802-473e-ba45-0ed35ea07e87 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:13.963603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48e2a2-f802-473e-ba45-0ed35ea07e87 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:13.964883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 661/1315] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:13.970317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816c23-af9f-403c-916c-7504adaab995 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:13.970806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816c23-af9f-403c-916c-7504adaab995 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:13.970904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816c23-af9f-403c-916c-7504adaab995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:14.036988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-01816c23-af9f-403c-916c-7504adaab995 None None] MFA Rules not processed for user `4f6db55a18244f29a68c5c078374063f`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:14.038749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-01816c23-af9f-403c-916c-7504adaab995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:14.091245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:14.136373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 655/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:14.442942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4cf7-0122-40f5-b25b-9ab38d595fef None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:14.443229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4cf7-0122-40f5-b25b-9ab38d595fef None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:14.443517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4cf7-0122-40f5-b25b-9ab38d595fef None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:14.445397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 662/1317] 10.222.0.16 () {54 vars in 964 bytes} [Thu Sep 22 14:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:14.451325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc223469-ac72-412f-a52c-b781e752a7d1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:14.451611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc223469-ac72-412f-a52c-b781e752a7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:14.451884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc223469-ac72-412f-a52c-b781e752a7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:14.529132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-bc223469-ac72-412f-a52c-b781e752a7d1 None None] MFA Rules not processed for user `75252b7cba4943b2874983d1a83a9175`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:14.530308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bc223469-ac72-412f-a52c-b781e752a7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:14.605664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 656/1318] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Sep 22 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:14.615636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4cf7-0122-40f5-b25b-9ab38d595fef None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:14.618110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ab1f4cf7-0122-40f5-b25b-9ab38d595fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:14.628035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:14.722658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4cf7-0122-40f5-b25b-9ab38d595fef None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:14.799581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eb804-cd7d-4a43-8e93-2d1fe0e05e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:14.800100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eb804-cd7d-4a43-8e93-2d1fe0e05e9a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:14.800375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eb804-cd7d-4a43-8e93-2d1fe0e05e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:14.800642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eb804-cd7d-4a43-8e93-2d1fe0e05e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:14.802293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-374eb804-cd7d-4a43-8e93-2d1fe0e05e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:14.862629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:14.908212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eb804-cd7d-4a43-8e93-2d1fe0e05e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:14.909624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eb804-cd7d-4a43-8e93-2d1fe0e05e9a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:14.927781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 663/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:18.268569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7ca8-215d-43ca-9b85-1d0805f33df0 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:18.269125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7ca8-215d-43ca-9b85-1d0805f33df0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:18.269125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7ca8-215d-43ca-9b85-1d0805f33df0 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:18.270504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 657/1320] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:18.275842 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6403e5b-85c2-4e9b-823d-9c816fc8a3dd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:18.276271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6403e5b-85c2-4e9b-823d-9c816fc8a3dd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:18.276420 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6403e5b-85c2-4e9b-823d-9c816fc8a3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:18.342910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b6403e5b-85c2-4e9b-823d-9c816fc8a3dd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:18.344147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b6403e5b-85c2-4e9b-823d-9c816fc8a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:18.441580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 664/1321] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:18.723146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7ca8-215d-43ca-9b85-1d0805f33df0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:18.724700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-39cf7ca8-215d-43ca-9b85-1d0805f33df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:18.775959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:18.829915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7ca8-215d-43ca-9b85-1d0805f33df0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:18.902540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd245b-85d2-419a-91ab-f10ac79ef4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:18.903193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd245b-85d2-419a-91ab-f10ac79ef4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:18.903469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd245b-85d2-419a-91ab-f10ac79ef4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:18.903736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd245b-85d2-419a-91ab-f10ac79ef4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:18.905340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-50bd245b-85d2-419a-91ab-f10ac79ef4e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:18.999745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:19.012990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd245b-85d2-419a-91ab-f10ac79ef4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:19.014947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd245b-85d2-419a-91ab-f10ac79ef4e3 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:19.031661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 658/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:22.220395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873fa1-844b-4de4-a9e1-485a838465a9 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:22.220923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873fa1-844b-4de4-a9e1-485a838465a9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:22.220923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873fa1-844b-4de4-a9e1-485a838465a9 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:22.222307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 665/1323] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:22.227632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1031-4552-424c-a2ba-fd8df0296553 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:22.228094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1031-4552-424c-a2ba-fd8df0296553 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:22.228226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1031-4552-424c-a2ba-fd8df0296553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:22.298713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a4ee1031-4552-424c-a2ba-fd8df0296553 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:22.299912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a4ee1031-4552-424c-a2ba-fd8df0296553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:22.397570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 659/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:22.704436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3873fa1-844b-4de4-a9e1-485a838465a9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:22.706127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e3873fa1-844b-4de4-a9e1-485a838465a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:22.732095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:22.822181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3873fa1-844b-4de4-a9e1-485a838465a9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:22.901502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad4bd3-9f29-4875-adb5-9de9e0caeb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:22.902149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4bd3-9f29-4875-adb5-9de9e0caeb97 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:22.902436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4bd3-9f29-4875-adb5-9de9e0caeb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:22.902710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad4bd3-9f29-4875-adb5-9de9e0caeb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:22.904329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-02ad4bd3-9f29-4875-adb5-9de9e0caeb97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:22.981891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:23.021361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad4bd3-9f29-4875-adb5-9de9e0caeb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:23.023594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad4bd3-9f29-4875-adb5-9de9e0caeb97 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:23.044082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 666/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:25.317655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2457-a870-46c3-8895-128056cae794 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:25.318278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2457-a870-46c3-8895-128056cae794 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:25.318278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2457-a870-46c3-8895-128056cae794 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:25.319727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 660/1326] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:25.325265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182337ee-3cbc-4afb-b900-d190e811b896 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:25.325730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182337ee-3cbc-4afb-b900-d190e811b896 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:25.325936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182337ee-3cbc-4afb-b900-d190e811b896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:25.392415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-182337ee-3cbc-4afb-b900-d190e811b896 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:25.393635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-182337ee-3cbc-4afb-b900-d190e811b896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:25.496155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 667/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:25.783178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a2457-a870-46c3-8895-128056cae794 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:25.784719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-600a2457-a870-46c3-8895-128056cae794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:25.847224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:25.891759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a2457-a870-46c3-8895-128056cae794 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:25.968159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d230-c078-4d76-a011-a9501d573346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:25.968762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d230-c078-4d76-a011-a9501d573346 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:25.969036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d230-c078-4d76-a011-a9501d573346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:25.969302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d230-c078-4d76-a011-a9501d573346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:25.970925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5113d230-c078-4d76-a011-a9501d573346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:26.081011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:26.083384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113d230-c078-4d76-a011-a9501d573346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:26.085446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113d230-c078-4d76-a011-a9501d573346 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:26.105443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 661/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:28.459488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745567bf-10e0-47b6-a27c-21dac74d1f27 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:28.460054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745567bf-10e0-47b6-a27c-21dac74d1f27 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:28.460054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745567bf-10e0-47b6-a27c-21dac74d1f27 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:28.461709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 668/1329] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:28.467761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255c3a-b9be-4061-a3d1-4eed74b1f06b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:28.468288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255c3a-b9be-4061-a3d1-4eed74b1f06b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:28.468379 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba255c3a-b9be-4061-a3d1-4eed74b1f06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:28.555058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ba255c3a-b9be-4061-a3d1-4eed74b1f06b None None] MFA Rules not processed for user `4f6db55a18244f29a68c5c078374063f`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:28.556313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ba255c3a-b9be-4061-a3d1-4eed74b1f06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:28.659270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 662/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:28.952164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745567bf-10e0-47b6-a27c-21dac74d1f27 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:28.953713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-745567bf-10e0-47b6-a27c-21dac74d1f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:28.985909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:29.060103 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745567bf-10e0-47b6-a27c-21dac74d1f27 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:29.141553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cc26b-f384-410e-a1ec-69b7c41493e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:29.142215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc26b-f384-410e-a1ec-69b7c41493e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:29.142499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc26b-f384-410e-a1ec-69b7c41493e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:29.142772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cc26b-f384-410e-a1ec-69b7c41493e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:29.144462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b99cc26b-f384-410e-a1ec-69b7c41493e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:29.229862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:29.264449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cc26b-f384-410e-a1ec-69b7c41493e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:29.265891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cc26b-f384-410e-a1ec-69b7c41493e8 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:29.285551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 669/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:31.971081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f0293-f48a-4399-965b-b829ca2fb9a4 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:31.971769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f0293-f48a-4399-965b-b829ca2fb9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:31.971769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f0293-f48a-4399-965b-b829ca2fb9a4 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:31.972958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 663/1332] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:31.979392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7a095-a75b-4a66-8e5b-718e8154c873 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:31.979858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7a095-a75b-4a66-8e5b-718e8154c873 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:31.979963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7a095-a75b-4a66-8e5b-718e8154c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:32.046273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6fa7a095-a75b-4a66-8e5b-718e8154c873 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:32.047497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6fa7a095-a75b-4a66-8e5b-718e8154c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:32.142849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 670/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:32.424115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f0293-f48a-4399-965b-b829ca2fb9a4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:32.425678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b84f0293-f48a-4399-965b-b829ca2fb9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:32.496506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:32.532809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f0293-f48a-4399-965b-b829ca2fb9a4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:32.607664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb289b-b0aa-41d5-8d41-1f75055a1a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:32.608278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb289b-b0aa-41d5-8d41-1f75055a1a87 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:32.608558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb289b-b0aa-41d5-8d41-1f75055a1a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:32.608836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb289b-b0aa-41d5-8d41-1f75055a1a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:32.610497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-38bb289b-b0aa-41d5-8d41-1f75055a1a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:32.719117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb289b-b0aa-41d5-8d41-1f75055a1a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:32.720551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb289b-b0aa-41d5-8d41-1f75055a1a87 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:32.730526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:32.738755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 664/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:35.014694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff775e-10a2-4be2-a8a6-6a8f98aeaccf None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:35.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff775e-10a2-4be2-a8a6-6a8f98aeaccf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:35.015263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff775e-10a2-4be2-a8a6-6a8f98aeaccf None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:35.016603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 671/1335] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:35.022283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77334-4c80-4972-b170-bfb067b0bc69 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:35.022774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77334-4c80-4972-b170-bfb067b0bc69 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:35.022880 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77334-4c80-4972-b170-bfb067b0bc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:35.088568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d9f77334-4c80-4972-b170-bfb067b0bc69 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:35.089783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d9f77334-4c80-4972-b170-bfb067b0bc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:35.186657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 665/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:35.473154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff775e-10a2-4be2-a8a6-6a8f98aeaccf None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:35.475033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fdff775e-10a2-4be2-a8a6-6a8f98aeaccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:35.518188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:35.584378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff775e-10a2-4be2-a8a6-6a8f98aeaccf None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:35.660722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080dacf-0bc9-4d88-8a51-7a8fe9016afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:35.661354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080dacf-0bc9-4d88-8a51-7a8fe9016afd service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:35.661636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080dacf-0bc9-4d88-8a51-7a8fe9016afd service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:35.661916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080dacf-0bc9-4d88-8a51-7a8fe9016afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:35.663581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3080dacf-0bc9-4d88-8a51-7a8fe9016afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:35.747508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:35.773164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080dacf-0bc9-4d88-8a51-7a8fe9016afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:35.774623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080dacf-0bc9-4d88-8a51-7a8fe9016afd service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:35.794567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 672/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:38.768752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650f50-dac4-4f82-a65a-5affeb3f68ce None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:38.769290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650f50-dac4-4f82-a65a-5affeb3f68ce None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:38.769290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650f50-dac4-4f82-a65a-5affeb3f68ce None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:38.770700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 666/1338] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:38.776528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea29b0-e798-4fb9-b21e-678fe9cd6051 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:38.776967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea29b0-e798-4fb9-b21e-678fe9cd6051 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:38.777089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea29b0-e798-4fb9-b21e-678fe9cd6051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:38.842679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-24ea29b0-e798-4fb9-b21e-678fe9cd6051 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:38.843884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-24ea29b0-e798-4fb9-b21e-678fe9cd6051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:38.940134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 673/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:39.220147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650f50-dac4-4f82-a65a-5affeb3f68ce None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:39.221690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5c650f50-dac4-4f82-a65a-5affeb3f68ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:39.300925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:39.331840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650f50-dac4-4f82-a65a-5affeb3f68ce None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:39.406059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb65a72-cb4c-4e22-9da6-8c0a0b82b3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:39.406672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65a72-cb4c-4e22-9da6-8c0a0b82b3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:39.406951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65a72-cb4c-4e22-9da6-8c0a0b82b3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:39.407220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb65a72-cb4c-4e22-9da6-8c0a0b82b3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:39.408847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bdb65a72-cb4c-4e22-9da6-8c0a0b82b3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:39.518088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb65a72-cb4c-4e22-9da6-8c0a0b82b3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:39.519533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb65a72-cb4c-4e22-9da6-8c0a0b82b3e8 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:39.538020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 667/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:44.067414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d9f8f-d68e-4aeb-9e0f-2959a274d02c None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:44.067858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d9f8f-d68e-4aeb-9e0f-2959a274d02c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:44.067950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d9f8f-d68e-4aeb-9e0f-2959a274d02c None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:44.069850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 674/1341] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:44.075681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993e8c-3fc3-4190-833b-fae2a411d5e5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:44.076203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993e8c-3fc3-4190-833b-fae2a411d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:44.076203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f993e8c-3fc3-4190-833b-fae2a411d5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:44.081692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:44.145189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1f993e8c-3fc3-4190-833b-fae2a411d5e5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:44.147139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1f993e8c-3fc3-4190-833b-fae2a411d5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:44.258142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 668/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:44.547443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d9f8f-d68e-4aeb-9e0f-2959a274d02c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:44.549605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-135d9f8f-d68e-4aeb-9e0f-2959a274d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:44.612111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:44.672223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d9f8f-d68e-4aeb-9e0f-2959a274d02c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:44.749695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41209ef-729a-454a-8a58-f45aa6ef5af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:44.750340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41209ef-729a-454a-8a58-f45aa6ef5af6 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:44.755220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41209ef-729a-454a-8a58-f45aa6ef5af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:44.755220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41209ef-729a-454a-8a58-f45aa6ef5af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:44.755220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e41209ef-729a-454a-8a58-f45aa6ef5af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:44.852161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:44.869766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41209ef-729a-454a-8a58-f45aa6ef5af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:44.871242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41209ef-729a-454a-8a58-f45aa6ef5af6 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:44.890511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 675/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:48.983965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae076-be1a-42c6-871f-7e951d7f4941 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:48.984460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae076-be1a-42c6-871f-7e951d7f4941 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:48.984542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae076-be1a-42c6-871f-7e951d7f4941 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:48.985862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 669/1344] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:48.992179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885d9ea-e2a2-459c-a282-30ec59632e7d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:48.992686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885d9ea-e2a2-459c-a282-30ec59632e7d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:48.992686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885d9ea-e2a2-459c-a282-30ec59632e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:49.065459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3885d9ea-e2a2-459c-a282-30ec59632e7d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:49.066722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3885d9ea-e2a2-459c-a282-30ec59632e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:49.175064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 676/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:49.466068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebae076-be1a-42c6-871f-7e951d7f4941 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:49.467623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cebae076-be1a-42c6-871f-7e951d7f4941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:49.558582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:49.575668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebae076-be1a-42c6-871f-7e951d7f4941 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:49.654317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d342a4-8fb9-4916-aa01-b9dd78e98d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:49.654947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d342a4-8fb9-4916-aa01-b9dd78e98d51 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:49.655228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d342a4-8fb9-4916-aa01-b9dd78e98d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:49.655501 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d342a4-8fb9-4916-aa01-b9dd78e98d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:49.657157 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-65d342a4-8fb9-4916-aa01-b9dd78e98d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:49.772731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d342a4-8fb9-4916-aa01-b9dd78e98d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:49.774241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d342a4-8fb9-4916-aa01-b9dd78e98d51 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:49.792885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 670/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:31:54.395533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd947be-4965-470a-bcaf-c03d7c793901 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:54.396778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd947be-4965-470a-bcaf-c03d7c793901 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:54.396778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd947be-4965-470a-bcaf-c03d7c793901 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:54.398318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 677/1347] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:31:54.403981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e223a9-6b88-4f2e-8cfb-e31bd9ff8107 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:54.404486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e223a9-6b88-4f2e-8cfb-e31bd9ff8107 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:54.404604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e223a9-6b88-4f2e-8cfb-e31bd9ff8107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:54.422139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:54.484316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e8e223a9-6b88-4f2e-8cfb-e31bd9ff8107 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:31:54.485547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e8e223a9-6b88-4f2e-8cfb-e31bd9ff8107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:54.602048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 671/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:31:54.888625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd947be-4965-470a-bcaf-c03d7c793901 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:31:54.890228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8fd947be-4965-470a-bcaf-c03d7c793901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:54.952889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:55.001273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd947be-4965-470a-bcaf-c03d7c793901 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:31:55.077900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0c65-1ff5-4557-bee2-38ff476909be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:31:55.078553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0c65-1ff5-4557-bee2-38ff476909be service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:31:55.078838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0c65-1ff5-4557-bee2-38ff476909be service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:31:55.079115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0c65-1ff5-4557-bee2-38ff476909be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:31:55.080787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-836c0c65-1ff5-4557-bee2-38ff476909be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:31:55.194903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:31:55.198543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c0c65-1ff5-4557-bee2-38ff476909be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:31:55.199994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c0c65-1ff5-4557-bee2-38ff476909be service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:31:55.219200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 678/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:00.273970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5670-e9d1-4777-91d5-06cde7e3ecdf None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:00.274495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5670-e9d1-4777-91d5-06cde7e3ecdf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:00.274581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5670-e9d1-4777-91d5-06cde7e3ecdf None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:00.276260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 672/1350] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:00.282334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ffc8-1038-488b-bfae-5cccdf764945 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:00.283143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ffc8-1038-488b-bfae-5cccdf764945 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:00.283611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ffc8-1038-488b-bfae-5cccdf764945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:00.421391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ee40ffc8-1038-488b-bfae-5cccdf764945 None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:00.422717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ee40ffc8-1038-488b-bfae-5cccdf764945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:00.554930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 679/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:04.601308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=59 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:04.606137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569d175-9696-4921-94ad-210566b26ccd None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:04.606810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569d175-9696-4921-94ad-210566b26ccd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:04.607115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569d175-9696-4921-94ad-210566b26ccd None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:04.608698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 673/1352] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:04.613810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d32fe-4272-43fc-a6e4-e9ccfb4107bf None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:04.615010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d32fe-4272-43fc-a6e4-e9ccfb4107bf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:04.629593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d32fe-4272-43fc-a6e4-e9ccfb4107bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:04.675433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:04.701047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-598d32fe-4272-43fc-a6e4-e9ccfb4107bf None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:04.702945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-598d32fe-4272-43fc-a6e4-e9ccfb4107bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:04.827881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 680/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:32:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:06.365339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b142fb-4a3c-446a-9f9f-1a64df93d415 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:06.365888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b142fb-4a3c-446a-9f9f-1a64df93d415 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:06.366055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b142fb-4a3c-446a-9f9f-1a64df93d415 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:06.367613 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 674/1354] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:06.373756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3405b-67cd-4db4-9366-6f857d15753f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:06.374253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3405b-67cd-4db4-9366-6f857d15753f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:06.374487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3405b-67cd-4db4-9366-6f857d15753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:06.455960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-bdf3405b-67cd-4db4-9366-6f857d15753f None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:06.457190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bdf3405b-67cd-4db4-9366-6f857d15753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:06.499588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:06.569445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 681/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:10.243871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b52eb5-8abe-4600-8248-2a7a05f4fb4b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:10.244399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b52eb5-8abe-4600-8248-2a7a05f4fb4b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:10.244399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b52eb5-8abe-4600-8248-2a7a05f4fb4b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:10.245729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 675/1356] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:10.251590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea5e1-9eef-4a0d-bb65-bc4e4cb20c6d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:10.252116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea5e1-9eef-4a0d-bb65-bc4e4cb20c6d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:10.252116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cea5e1-9eef-4a0d-bb65-bc4e4cb20c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:10.328185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-15cea5e1-9eef-4a0d-bb65-bc4e4cb20c6d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:10.329393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-15cea5e1-9eef-4a0d-bb65-bc4e4cb20c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:10.438110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 682/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:10.742679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcaaef-f2f6-43a2-bba7-2d8068e16a4c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:10.743323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcaaef-f2f6-43a2-bba7-2d8068e16a4c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:10.743807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcaaef-f2f6-43a2-bba7-2d8068e16a4c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:10.746458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 676/1358] 10.222.0.16 () {54 vars in 961 bytes} [Thu Sep 22 14:32:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:10.755891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1d24-1cae-4e6c-8eee-3362a93b3892 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:10.757179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1d24-1cae-4e6c-8eee-3362a93b3892 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:10.757722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff1d24-1cae-4e6c-8eee-3362a93b3892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:10.774542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:10.844987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-20ff1d24-1cae-4e6c-8eee-3362a93b3892 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:10.846363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-20ff1d24-1cae-4e6c-8eee-3362a93b3892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:10.972622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 683/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Sep 22 14:32:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:10.981142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcaaef-f2f6-43a2-bba7-2d8068e16a4c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:10.982831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-72fcaaef-f2f6-43a2-bba7-2d8068e16a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:11.152398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcaaef-f2f6-43a2-bba7-2d8068e16a4c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:11.241513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:11.288723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31662bf3-b5cd-422d-bd35-62799f6dc065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:11.289414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662bf3-b5cd-422d-bd35-62799f6dc065 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:11.289643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662bf3-b5cd-422d-bd35-62799f6dc065 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:11.289875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31662bf3-b5cd-422d-bd35-62799f6dc065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:11.291536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-31662bf3-b5cd-422d-bd35-62799f6dc065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:11.389200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31662bf3-b5cd-422d-bd35-62799f6dc065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:11.390933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31662bf3-b5cd-422d-bd35-62799f6dc065 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:11.411934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 677/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:32:13.840276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9478-922a-4b21-84f3-bba543d5f0d0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:13.840801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9478-922a-4b21-84f3-bba543d5f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:13.840801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf9478-922a-4b21-84f3-bba543d5f0d0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:13.842114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 684/1361] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:13.847505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87e7b-fcf3-489b-8295-88b5131a19ce None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:13.848367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87e7b-fcf3-489b-8295-88b5131a19ce None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:13.849288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c87e7b-fcf3-489b-8295-88b5131a19ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:13.920137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-73c87e7b-fcf3-489b-8295-88b5131a19ce None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:13.921345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-73c87e7b-fcf3-489b-8295-88b5131a19ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:13.961306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:14.067737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 678/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:14.353736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9478-922a-4b21-84f3-bba543d5f0d0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:14.355302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fdaf9478-922a-4b21-84f3-bba543d5f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:14.435618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:14.563971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf9478-922a-4b21-84f3-bba543d5f0d0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:14.757360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376d248-adc1-4d5c-9df5-9b43a9d03f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:14.758100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d248-adc1-4d5c-9df5-9b43a9d03f05 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:14.758484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d248-adc1-4d5c-9df5-9b43a9d03f05 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:14.758764 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d248-adc1-4d5c-9df5-9b43a9d03f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:14.761545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9376d248-adc1-4d5c-9df5-9b43a9d03f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:14.797052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:14.882081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376d248-adc1-4d5c-9df5-9b43a9d03f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:14.882081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376d248-adc1-4d5c-9df5-9b43a9d03f05 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:14.903183 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 685/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:17.787463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9281d-6a38-4b18-80d1-18c3ca5365d0 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:17.790459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9281d-6a38-4b18-80d1-18c3ca5365d0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:17.790971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9281d-6a38-4b18-80d1-18c3ca5365d0 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:17.792836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 679/1364] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:17.802061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c425-033e-4436-801f-384f7de3aa7d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:17.802061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c425-033e-4436-801f-384f7de3aa7d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:17.802061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c425-033e-4436-801f-384f7de3aa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:17.878942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-80b2c425-033e-4436-801f-384f7de3aa7d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:17.880874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-80b2c425-033e-4436-801f-384f7de3aa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:18.000013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:18.009718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 686/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:32:18.314947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f279cf-30e0-4c22-bbd6-28474f5cee3f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:18.321026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f279cf-30e0-4c22-bbd6-28474f5cee3f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:18.321026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f279cf-30e0-4c22-bbd6-28474f5cee3f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:18.321026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 680/1366] 10.222.0.16 () {54 vars in 961 bytes} [Thu Sep 22 14:32:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:18.324050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6141-e25d-443a-b5da-a2afeed6f81a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:18.324568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6141-e25d-443a-b5da-a2afeed6f81a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:18.325078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6141-e25d-443a-b5da-a2afeed6f81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:18.419143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-528c6141-e25d-443a-b5da-a2afeed6f81a None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:18.421130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-528c6141-e25d-443a-b5da-a2afeed6f81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:18.584898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f279cf-30e0-4c22-bbd6-28474f5cee3f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:18.588084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 687/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Sep 22 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:32:18.588470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-37f279cf-30e0-4c22-bbd6-28474f5cee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:18.783475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f279cf-30e0-4c22-bbd6-28474f5cee3f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:18.809605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:18.936262 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06686e69-2717-4549-9c3a-7a480122ecac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:18.936959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06686e69-2717-4549-9c3a-7a480122ecac service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:18.937310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06686e69-2717-4549-9c3a-7a480122ecac service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:18.937611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06686e69-2717-4549-9c3a-7a480122ecac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:18.939493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-06686e69-2717-4549-9c3a-7a480122ecac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:19.063932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06686e69-2717-4549-9c3a-7a480122ecac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:19.065607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06686e69-2717-4549-9c3a-7a480122ecac service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:19.071957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea55d7-ea14-4a49-a5c3-1680c5a9b0ed None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:19.072438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea55d7-ea14-4a49-a5c3-1680c5a9b0ed None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:19.072520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea55d7-ea14-4a49-a5c3-1680c5a9b0ed None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:19.073836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 688/1368] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:32:19.079141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471bab-b7e6-491d-838a-142c71f11b82 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:19.079535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471bab-b7e6-491d-838a-142c71f11b82 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:19.079922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471bab-b7e6-491d-838a-142c71f11b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:19.088902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 681/1369] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:32:19.145612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:19.154093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5b471bab-b7e6-491d-838a-142c71f11b82 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:19.155620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5b471bab-b7e6-491d-838a-142c71f11b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:19.293949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 689/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:32:19.619885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca752-2884-4965-8ec8-acf91ac1abd7 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:19.620100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca752-2884-4965-8ec8-acf91ac1abd7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:19.620348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdca752-2884-4965-8ec8-acf91ac1abd7 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:19.621864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 682/1371] 10.222.0.16 () {54 vars in 963 bytes} [Thu Sep 22 14:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:19.627333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e743df-ca9e-4b56-b6b2-56e69b8a2d7e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:19.627749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e743df-ca9e-4b56-b6b2-56e69b8a2d7e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:19.628129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e743df-ca9e-4b56-b6b2-56e69b8a2d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:19.739723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d5e743df-ca9e-4b56-b6b2-56e69b8a2d7e None None] MFA Rules not processed for user `58f40fbc281849418ef9d4c75562c56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:19.741306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d5e743df-ca9e-4b56-b6b2-56e69b8a2d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:19.835067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:19.844843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 690/1372] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Sep 22 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:19.864387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdca752-2884-4965-8ec8-acf91ac1abd7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:19.864387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ebdca752-2884-4965-8ec8-acf91ac1abd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:19.891939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:19.995060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdca752-2884-4965-8ec8-acf91ac1abd7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:20.115469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a7f4b-807a-42b1-bdf6-5ed98fe07cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:20.116135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a7f4b-807a-42b1-bdf6-5ed98fe07cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:20.116446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a7f4b-807a-42b1-bdf6-5ed98fe07cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:20.116900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a7f4b-807a-42b1-bdf6-5ed98fe07cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:20.122802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1c2a7f4b-807a-42b1-bdf6-5ed98fe07cb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:20.220113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:20.262969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a7f4b-807a-42b1-bdf6-5ed98fe07cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:20.269027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a7f4b-807a-42b1-bdf6-5ed98fe07cb2 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:20.290969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 683/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:21.607802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d03f8-b3cf-4ece-85ae-aa32760fb3ec None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:21.608322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d03f8-b3cf-4ece-85ae-aa32760fb3ec None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:21.608420 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d03f8-b3cf-4ece-85ae-aa32760fb3ec None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:21.610764 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 691/1374] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:21.615787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b903-e478-46d3-a75b-0e83e5808334 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:21.616254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b903-e478-46d3-a75b-0e83e5808334 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:21.616350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b903-e478-46d3-a75b-0e83e5808334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:21.688317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-65f3b903-e478-46d3-a75b-0e83e5808334 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:21.689518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-65f3b903-e478-46d3-a75b-0e83e5808334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:21.800571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 684/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:22.096314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d03f8-b3cf-4ece-85ae-aa32760fb3ec None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:22.098007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d21d03f8-b3cf-4ece-85ae-aa32760fb3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:22.299089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d03f8-b3cf-4ece-85ae-aa32760fb3ec None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:22.386845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:22.444043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ba6cd-aeda-49b4-9f2e-23c5021a3dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:22.444846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba6cd-aeda-49b4-9f2e-23c5021a3dc5 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:22.445130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba6cd-aeda-49b4-9f2e-23c5021a3dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:22.445411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ba6cd-aeda-49b4-9f2e-23c5021a3dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:22.447500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4f5ba6cd-aeda-49b4-9f2e-23c5021a3dc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:22.562706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ba6cd-aeda-49b4-9f2e-23c5021a3dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:22.564313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ba6cd-aeda-49b4-9f2e-23c5021a3dc5 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:22.586668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 692/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:32:25.096044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39126-1954-4f36-96c8-c85bce258ace None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:25.096658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39126-1954-4f36-96c8-c85bce258ace None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:25.096658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39126-1954-4f36-96c8-c85bce258ace None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:25.098890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 685/1377] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:25.104132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5183bb-bdb1-4af3-b32f-c0a373a5880b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:25.104689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5183bb-bdb1-4af3-b32f-c0a373a5880b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:25.104689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5183bb-bdb1-4af3-b32f-c0a373a5880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:25.182022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-eb5183bb-bdb1-4af3-b32f-c0a373a5880b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:25.183247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-eb5183bb-bdb1-4af3-b32f-c0a373a5880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:25.215975 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:25.303899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 693/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:32:25.602719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39126-1954-4f36-96c8-c85bce258ace None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:25.604452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c7d39126-1954-4f36-96c8-c85bce258ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:25.649852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:25.765504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39126-1954-4f36-96c8-c85bce258ace None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:25.879258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:25.884944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a81326-bfa4-4bec-8699-a2093ea4b50d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:25.885679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81326-bfa4-4bec-8699-a2093ea4b50d service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:25.886089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81326-bfa4-4bec-8699-a2093ea4b50d service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:25.886490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a81326-bfa4-4bec-8699-a2093ea4b50d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:25.888291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b4a81326-bfa4-4bec-8699-a2093ea4b50d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:25.987923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a81326-bfa4-4bec-8699-a2093ea4b50d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:25.990245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a81326-bfa4-4bec-8699-a2093ea4b50d service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:26.011228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 686/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:28.610538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77da02-4eec-4788-8f09-86d8ce22b8f3 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:28.611175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77da02-4eec-4788-8f09-86d8ce22b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:28.611175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77da02-4eec-4788-8f09-86d8ce22b8f3 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:28.621260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 694/1380] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:28.624500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67f635-a22d-4508-bfbc-b881172605fb None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:28.625099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67f635-a22d-4508-bfbc-b881172605fb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:28.625400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67f635-a22d-4508-bfbc-b881172605fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:28.729080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6c67f635-a22d-4508-bfbc-b881172605fb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:28.730339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6c67f635-a22d-4508-bfbc-b881172605fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:28.817142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:28.851043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 687/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:29.157164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77da02-4eec-4788-8f09-86d8ce22b8f3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:29.159310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6d77da02-4eec-4788-8f09-86d8ce22b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:29.337192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77da02-4eec-4788-8f09-86d8ce22b8f3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:29.353398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:29.490654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f400af-26ae-42b8-a8a2-2eb590329176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:29.491478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f400af-26ae-42b8-a8a2-2eb590329176 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:29.491867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f400af-26ae-42b8-a8a2-2eb590329176 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:29.492242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f400af-26ae-42b8-a8a2-2eb590329176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:29.494101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-13f400af-26ae-42b8-a8a2-2eb590329176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:29.607756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f400af-26ae-42b8-a8a2-2eb590329176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:29.609689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f400af-26ae-42b8-a8a2-2eb590329176 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:29.633636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 695/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:32.537657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856884b5-a119-432f-bd9d-aa073774907b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:32.538332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856884b5-a119-432f-bd9d-aa073774907b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:32.538332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856884b5-a119-432f-bd9d-aa073774907b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:32.539595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 688/1383] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:32.550218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec291-f9e2-49a0-86d6-a0fccb6591aa None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:32.551472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec291-f9e2-49a0-86d6-a0fccb6591aa None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:32.551696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec291-f9e2-49a0-86d6-a0fccb6591aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:32.583014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:32.638582 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-330ec291-f9e2-49a0-86d6-a0fccb6591aa None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:32.639820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-330ec291-f9e2-49a0-86d6-a0fccb6591aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:32.764747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 696/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:33.056838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856884b5-a119-432f-bd9d-aa073774907b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:33.058514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-856884b5-a119-432f-bd9d-aa073774907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:33.249646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856884b5-a119-432f-bd9d-aa073774907b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:33.307599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:33.373256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a211924-1411-47cb-8369-753ad871707b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:33.373844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a211924-1411-47cb-8369-753ad871707b service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:33.374156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a211924-1411-47cb-8369-753ad871707b service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:33.374426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a211924-1411-47cb-8369-753ad871707b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:33.376050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9a211924-1411-47cb-8369-753ad871707b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:33.485464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a211924-1411-47cb-8369-753ad871707b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:33.487105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a211924-1411-47cb-8369-753ad871707b service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:33.507541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 689/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:35.987419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe797cc-6e23-4218-8184-1d8d535e697b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:35.988010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe797cc-6e23-4218-8184-1d8d535e697b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:35.988010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe797cc-6e23-4218-8184-1d8d535e697b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:35.989394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 697/1386] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:35.995870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce76ff-90b8-49ca-97de-1dd55ac39b79 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:36.001547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce76ff-90b8-49ca-97de-1dd55ac39b79 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:36.001547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce76ff-90b8-49ca-97de-1dd55ac39b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:36.068378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-05ce76ff-90b8-49ca-97de-1dd55ac39b79 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:36.069693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-05ce76ff-90b8-49ca-97de-1dd55ac39b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:36.078569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:36.212030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 690/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:36.544117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe797cc-6e23-4218-8184-1d8d535e697b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:36.545684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0fe797cc-6e23-4218-8184-1d8d535e697b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:36.649598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:36.715666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe797cc-6e23-4218-8184-1d8d535e697b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:36.826196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79510-da63-492b-a24f-940f514fa7aa None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:36.826501 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79510-da63-492b-a24f-940f514fa7aa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:36.826850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea79510-da63-492b-a24f-940f514fa7aa None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:36.828466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 691/1388] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:32:36.836113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282050d2-a82f-4ce3-af80-84f04509d353 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:36.836534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282050d2-a82f-4ce3-af80-84f04509d353 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:36.836882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282050d2-a82f-4ce3-af80-84f04509d353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:36.848508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e854b5-c120-42d7-86d1-cbd80e4bb48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:36.849268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e854b5-c120-42d7-86d1-cbd80e4bb48f service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:36.849543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e854b5-c120-42d7-86d1-cbd80e4bb48f service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:36.849811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e854b5-c120-42d7-86d1-cbd80e4bb48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:36.851673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-83e854b5-c120-42d7-86d1-cbd80e4bb48f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:36.913328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-282050d2-a82f-4ce3-af80-84f04509d353 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:36.914658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-282050d2-a82f-4ce3-af80-84f04509d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:36.918204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:36.949580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e854b5-c120-42d7-86d1-cbd80e4bb48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:36.951262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e854b5-c120-42d7-86d1-cbd80e4bb48f service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:36.974377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 698/1389] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:37.018080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:37.035781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 692/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:32:37.334742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e2af7-cf8a-492e-a7e8-d2fb02f7389a None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:37.335307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e2af7-cf8a-492e-a7e8-d2fb02f7389a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:37.335307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e2af7-cf8a-492e-a7e8-d2fb02f7389a None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:37.336722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 699/1391] 10.222.0.16 () {54 vars in 962 bytes} [Thu Sep 22 14:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:37.342769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530403-818a-41f6-ae90-006f4b498460 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:37.343111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530403-818a-41f6-ae90-006f4b498460 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:37.343378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530403-818a-41f6-ae90-006f4b498460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:37.432766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ae530403-818a-41f6-ae90-006f4b498460 None None] MFA Rules not processed for user `71dca3ee8b78402eb95815eb200d90a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:37.434003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ae530403-818a-41f6-ae90-006f4b498460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:37.518373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 693/1392] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Sep 22 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:37.527889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e2af7-cf8a-492e-a7e8-d2fb02f7389a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:37.529478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a75e2af7-cf8a-492e-a7e8-d2fb02f7389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:37.644830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e2af7-cf8a-492e-a7e8-d2fb02f7389a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:37.733223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589104f-506f-4c9a-a0b8-16d550f570a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dca3ee8b78402eb95815eb200d90a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:37.733832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589104f-506f-4c9a-a0b8-16d550f570a8 service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:37.734198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589104f-506f-4c9a-a0b8-16d550f570a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:37.734905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589104f-506f-4c9a-a0b8-16d550f570a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:37.736626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4589104f-506f-4c9a-a0b8-16d550f570a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:37.746375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:37.857302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589104f-506f-4c9a-a0b8-16d550f570a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:37.858779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589104f-506f-4c9a-a0b8-16d550f570a8 service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:37.878331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 700/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:38.796928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af37d6-5ca4-4ac3-a74c-8b842563ab34 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:38.797436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af37d6-5ca4-4ac3-a74c-8b842563ab34 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:38.797595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af37d6-5ca4-4ac3-a74c-8b842563ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:38.872167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-53af37d6-5ca4-4ac3-a74c-8b842563ab34 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:38.873490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-53af37d6-5ca4-4ac3-a74c-8b842563ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:38.910119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:38.969777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 694/1394] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:32:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:39.014921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a97e-389e-4000-903b-423c0b0e221e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:39.015451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a97e-389e-4000-903b-423c0b0e221e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:39.015451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56a97e-389e-4000-903b-423c0b0e221e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:39.016883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 701/1395] 10.222.0.16 () {54 vars in 943 bytes} [Thu Sep 22 14:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:39.024844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27688463-8e17-4eaa-98f4-1cf33ff48fbe None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:39.025264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27688463-8e17-4eaa-98f4-1cf33ff48fbe None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:39.025669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27688463-8e17-4eaa-98f4-1cf33ff48fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:39.110264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-27688463-8e17-4eaa-98f4-1cf33ff48fbe None None] MFA Rules not processed for user `3d98f829fb354c98a2e170d7f2a00874`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:39.111597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-27688463-8e17-4eaa-98f4-1cf33ff48fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:39.240483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 695/1396] 10.222.0.16 () {58 vars in 1040 bytes} [Thu Sep 22 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:39.250640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a97e-389e-4000-903b-423c0b0e221e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:39.252256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7c56a97e-389e-4000-903b-423c0b0e221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:39.350441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ce57-102d-4191-af3a-249271f1eff3 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:39.350710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ce57-102d-4191-af3a-249271f1eff3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:39.350980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ce57-102d-4191-af3a-249271f1eff3 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:39.352338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 696/1397] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:32:39.357405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ed1bb-da23-4205-8cce-919b57ed8d7e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:39.357683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ed1bb-da23-4205-8cce-919b57ed8d7e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:39.357962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ed1bb-da23-4205-8cce-919b57ed8d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:39.366137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:39.368165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:39.395731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56a97e-389e-4000-903b-423c0b0e221e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:39.427942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1e7ed1bb-da23-4205-8cce-919b57ed8d7e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:39.429506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1e7ed1bb-da23-4205-8cce-919b57ed8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:39.510570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f1047-938a-4201-918e-44d0d4818a25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:39.511096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f1047-938a-4201-918e-44d0d4818a25 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:39.511381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f1047-938a-4201-918e-44d0d4818a25 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:39.511657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f1047-938a-4201-918e-44d0d4818a25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:39.513378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c07f1047-938a-4201-918e-44d0d4818a25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:39.533909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 697/1398] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:32:39.607233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f1047-938a-4201-918e-44d0d4818a25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:39.608844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f1047-938a-4201-918e-44d0d4818a25 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:39.618442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 702/1399] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:32:39.829615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ed1bb-da23-4205-8cce-919b57ed8d7e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:39.830973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1e7ed1bb-da23-4205-8cce-919b57ed8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:39.920243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:39.956850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ed1bb-da23-4205-8cce-919b57ed8d7e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:40.115514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcd6cb-002b-4112-bae0-a598d090fcdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:40.116143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcd6cb-002b-4112-bae0-a598d090fcdd service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:40.116500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcd6cb-002b-4112-bae0-a598d090fcdd service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:40.116841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcd6cb-002b-4112-bae0-a598d090fcdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:40.118675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3bdcd6cb-002b-4112-bae0-a598d090fcdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:40.219893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:40.232786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcd6cb-002b-4112-bae0-a598d090fcdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:40.234519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcd6cb-002b-4112-bae0-a598d090fcdd service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:40.262310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 698/1400] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:42.715649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661adb-3b11-4848-8c7b-5b87cc5619cf None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:42.716209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661adb-3b11-4848-8c7b-5b87cc5619cf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:42.716209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661adb-3b11-4848-8c7b-5b87cc5619cf None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:42.718271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 703/1401] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:42.729439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9b1ff-9a65-4bf9-8b5a-8f8d0582bbfe None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:42.730075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9b1ff-9a65-4bf9-8b5a-8f8d0582bbfe None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:42.730075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9b1ff-9a65-4bf9-8b5a-8f8d0582bbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:42.813403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-67c9b1ff-9a65-4bf9-8b5a-8f8d0582bbfe None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:42.818006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-67c9b1ff-9a65-4bf9-8b5a-8f8d0582bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:42.937757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 699/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:32:43.231034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661adb-3b11-4848-8c7b-5b87cc5619cf None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:43.232627 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ae661adb-3b11-4848-8c7b-5b87cc5619cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:43.246299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:43.392384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661adb-3b11-4848-8c7b-5b87cc5619cf None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:43.489563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:43.524726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240af045-81f6-4c1f-8260-2e88f866dbd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:43.525339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af045-81f6-4c1f-8260-2e88f866dbd2 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:43.525620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af045-81f6-4c1f-8260-2e88f866dbd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:43.525891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af045-81f6-4c1f-8260-2e88f866dbd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:43.527558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-240af045-81f6-4c1f-8260-2e88f866dbd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:43.625386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240af045-81f6-4c1f-8260-2e88f866dbd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:43.627032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240af045-81f6-4c1f-8260-2e88f866dbd2 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:43.649489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 704/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:46.027665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d763-1302-4f5b-a80c-27d17039dcf4 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:46.028287 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d763-1302-4f5b-a80c-27d17039dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:46.028287 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796d763-1302-4f5b-a80c-27d17039dcf4 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:46.029549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 700/1404] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:46.035497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3d8f1-b745-49f5-85f7-1e29c12f7660 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:46.040149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3d8f1-b745-49f5-85f7-1e29c12f7660 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:46.040149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3d8f1-b745-49f5-85f7-1e29c12f7660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:46.127019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-85c3d8f1-b745-49f5-85f7-1e29c12f7660 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:46.128601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-85c3d8f1-b745-49f5-85f7-1e29c12f7660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:46.183971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:46.240349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 705/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:46.538043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796d763-1302-4f5b-a80c-27d17039dcf4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:46.540005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c796d763-1302-4f5b-a80c-27d17039dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:46.617487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:46.714641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796d763-1302-4f5b-a80c-27d17039dcf4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:46.848220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10e1b-68ca-48e5-8a30-b09ad7cd5521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:46.848954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10e1b-68ca-48e5-8a30-b09ad7cd5521 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:46.849281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10e1b-68ca-48e5-8a30-b09ad7cd5521 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:46.849625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10e1b-68ca-48e5-8a30-b09ad7cd5521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:46.851659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-90f10e1b-68ca-48e5-8a30-b09ad7cd5521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:46.876305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:46.957040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f10e1b-68ca-48e5-8a30-b09ad7cd5521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:46.959297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f10e1b-68ca-48e5-8a30-b09ad7cd5521 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:46.979095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 701/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:49.475798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce453d8-b12e-4d0b-a8ff-47c0339a5dfc None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:49.476361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce453d8-b12e-4d0b-a8ff-47c0339a5dfc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:49.476361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce453d8-b12e-4d0b-a8ff-47c0339a5dfc None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:49.477686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 706/1407] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:32:49.482996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a975-64be-4592-b386-cd6d76bf787b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:49.483543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a975-64be-4592-b386-cd6d76bf787b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:49.483543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76a975-64be-4592-b386-cd6d76bf787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:49.560379 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8b76a975-64be-4592-b386-cd6d76bf787b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:32:49.561525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8b76a975-64be-4592-b386-cd6d76bf787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:49.672043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:49.675877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 702/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:32:49.982297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce453d8-b12e-4d0b-a8ff-47c0339a5dfc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:32:49.984013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9ce453d8-b12e-4d0b-a8ff-47c0339a5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:50.152951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce453d8-b12e-4d0b-a8ff-47c0339a5dfc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:32:50.192104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:32:50.330260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509d691-a79c-493b-9250-36cef90643a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:32:50.331036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509d691-a79c-493b-9250-36cef90643a2 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:32:50.331433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509d691-a79c-493b-9250-36cef90643a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:32:50.331803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509d691-a79c-493b-9250-36cef90643a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:32:50.334014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5509d691-a79c-493b-9250-36cef90643a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:32:50.493757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509d691-a79c-493b-9250-36cef90643a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:32:50.497684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509d691-a79c-493b-9250-36cef90643a2 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:32:50.539219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 707/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:32:59.704403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:00.521213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=84 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:04.498824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e33d7-5b7a-49f3-9651-4fda81c5029f None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:04.499458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e33d7-5b7a-49f3-9651-4fda81c5029f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:04.499458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e33d7-5b7a-49f3-9651-4fda81c5029f None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:04.500601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 703/1410] 10.222.0.16 () {54 vars in 918 bytes} [Thu Sep 22 14:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:04.506140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534568e-275a-47a6-9379-2f5692877a46 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:04.506589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534568e-275a-47a6-9379-2f5692877a46 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:04.506828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534568e-275a-47a6-9379-2f5692877a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:04.591646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b534568e-275a-47a6-9379-2f5692877a46 None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:04.592895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b534568e-275a-47a6-9379-2f5692877a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:04.699989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 708/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 22 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:04.715325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a24a25-fc84-4541-bc95-a6019dd3661b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:04.715606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a24a25-fc84-4541-bc95-a6019dd3661b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:04.715878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a24a25-fc84-4541-bc95-a6019dd3661b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:04.717196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 704/1412] 10.222.0.16 () {54 vars in 918 bytes} [Thu Sep 22 14:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:04.722046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8845fa-f4a9-48c4-80a3-ab6ae2fabe61 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:04.722334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8845fa-f4a9-48c4-80a3-ab6ae2fabe61 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:04.722606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8845fa-f4a9-48c4-80a3-ab6ae2fabe61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:04.795970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:04.799118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7b8845fa-f4a9-48c4-80a3-ab6ae2fabe61 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:04.800365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7b8845fa-f4a9-48c4-80a3-ab6ae2fabe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:04.918346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 709/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 22 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:07.565090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6757f8-dac1-4d6d-94f8-088308c6b7df None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:07.565633 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6757f8-dac1-4d6d-94f8-088308c6b7df None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:07.565633 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6757f8-dac1-4d6d-94f8-088308c6b7df None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:07.566931 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:07.572619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db9b10-554e-4008-9046-25bb0853597b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:07.573039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db9b10-554e-4008-9046-25bb0853597b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:07.573280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db9b10-554e-4008-9046-25bb0853597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:07.641460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f2db9b10-554e-4008-9046-25bb0853597b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:07.643185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f2db9b10-554e-4008-9046-25bb0853597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:07.704289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:07.749564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:08.039178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6757f8-dac1-4d6d-94f8-088308c6b7df None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:08.041389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fb6757f8-dac1-4d6d-94f8-088308c6b7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:08.197322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6757f8-dac1-4d6d-94f8-088308c6b7df None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:08.271167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:08.311144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c88ca8-8153-4c8a-a9ca-8d3a5c0c97ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:08.311677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88ca8-8153-4c8a-a9ca-8d3a5c0c97ec service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:08.311953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88ca8-8153-4c8a-a9ca-8d3a5c0c97ec service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:08.312222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88ca8-8153-4c8a-a9ca-8d3a5c0c97ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:08.313835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-24c88ca8-8153-4c8a-a9ca-8d3a5c0c97ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:08.407463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c88ca8-8153-4c8a-a9ca-8d3a5c0c97ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:08.409054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c88ca8-8153-4c8a-a9ca-8d3a5c0c97ec service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:08.426787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 706/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:09.578086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6cd6-3b64-41ad-b41e-39228eb33218 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:09.578636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6cd6-3b64-41ad-b41e-39228eb33218 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:09.578636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6cd6-3b64-41ad-b41e-39228eb33218 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:09.579864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:33:09.587180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf726a9-d258-40e8-ad92-95299837d235 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:09.587673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf726a9-d258-40e8-ad92-95299837d235 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:09.587785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf726a9-d258-40e8-ad92-95299837d235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:09.666009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9bf726a9-d258-40e8-ad92-95299837d235 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:09.667246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9bf726a9-d258-40e8-ad92-95299837d235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:09.694288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:09.768747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:09.936380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c6cd6-3b64-41ad-b41e-39228eb33218 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:09.937862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b54c6cd6-3b64-41ad-b41e-39228eb33218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:10.092401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c6cd6-3b64-41ad-b41e-39228eb33218 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:10.135060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:10.218565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a82404-3eb8-4169-b79c-bcb4ab7742dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:10.219092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82404-3eb8-4169-b79c-bcb4ab7742dd service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:10.219374 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82404-3eb8-4169-b79c-bcb4ab7742dd service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:10.219644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a82404-3eb8-4169-b79c-bcb4ab7742dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:10.221300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-78a82404-3eb8-4169-b79c-bcb4ab7742dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:10.316825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a82404-3eb8-4169-b79c-bcb4ab7742dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:10.318460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a82404-3eb8-4169-b79c-bcb4ab7742dd service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:10.336876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 712/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:11.504864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb07ca4-e552-4f89-b28f-84473b9eb0c8 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:11.505396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb07ca4-e552-4f89-b28f-84473b9eb0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:11.505396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb07ca4-e552-4f89-b28f-84473b9eb0c8 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:11.506702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:11.513659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd85f4-a0a6-4499-af90-0e23720a08d4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:11.514188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd85f4-a0a6-4499-af90-0e23720a08d4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:11.514287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd85f4-a0a6-4499-af90-0e23720a08d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:11.568798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:11.592450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-cadd85f4-a0a6-4499-af90-0e23720a08d4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:11.593657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cadd85f4-a0a6-4499-af90-0e23720a08d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:11.689457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:33:11.842036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb07ca4-e552-4f89-b28f-84473b9eb0c8 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:11.843533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-afb07ca4-e552-4f89-b28f-84473b9eb0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:11.988583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb07ca4-e552-4f89-b28f-84473b9eb0c8 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:12.001824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:12.107365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8d6c4-3205-4815-96b5-8020864194e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:12.107898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d6c4-3205-4815-96b5-8020864194e9 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:12.108204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d6c4-3205-4815-96b5-8020864194e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:12.108481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d6c4-3205-4815-96b5-8020864194e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:12.110140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-66f8d6c4-3205-4815-96b5-8020864194e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:12.203459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8d6c4-3205-4815-96b5-8020864194e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:12.205118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8d6c4-3205-4815-96b5-8020864194e9 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:12.224402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 709/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:13.367954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819224-c7c9-4ed4-b76d-447a0292c54f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:13.368499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819224-c7c9-4ed4-b76d-447a0292c54f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:13.368499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22819224-c7c9-4ed4-b76d-447a0292c54f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:13.369849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:33:13.376388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86466-eab3-4359-9da9-26c228f05665 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:13.376870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86466-eab3-4359-9da9-26c228f05665 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:13.376988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d86466-eab3-4359-9da9-26c228f05665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:13.397128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:13.455250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-28d86466-eab3-4359-9da9-26c228f05665 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:13.456466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-28d86466-eab3-4359-9da9-26c228f05665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:13.554814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:33:13.705750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819224-c7c9-4ed4-b76d-447a0292c54f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:13.707297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-22819224-c7c9-4ed4-b76d-447a0292c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:13.818540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:13.854361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22819224-c7c9-4ed4-b76d-447a0292c54f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:13.969411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19033a26-4d60-42aa-8517-782b6c371a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:13.970076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19033a26-4d60-42aa-8517-782b6c371a6f service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:13.970361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19033a26-4d60-42aa-8517-782b6c371a6f service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:13.970633 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19033a26-4d60-42aa-8517-782b6c371a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:13.972249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-19033a26-4d60-42aa-8517-782b6c371a6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:14.051705 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:14.065424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19033a26-4d60-42aa-8517-782b6c371a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:14.067066 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19033a26-4d60-42aa-8517-782b6c371a6f service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:14.087184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 715/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:15.204863 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd35b-5d89-48d1-b2a9-84320325ad1d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:15.205443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd35b-5d89-48d1-b2a9-84320325ad1d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:15.205443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd35b-5d89-48d1-b2a9-84320325ad1d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:15.206771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:15.213448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba9ca-e402-4afa-bd69-231caf991ece None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:15.214292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba9ca-e402-4afa-bd69-231caf991ece None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:15.214572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba9ca-e402-4afa-bd69-231caf991ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:15.292123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b83ba9ca-e402-4afa-bd69-231caf991ece None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:15.293333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b83ba9ca-e402-4afa-bd69-231caf991ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:15.389156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:15.540243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd35b-5d89-48d1-b2a9-84320325ad1d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:15.541867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-eacbd35b-5d89-48d1-b2a9-84320325ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:15.630226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:15.696514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd35b-5d89-48d1-b2a9-84320325ad1d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:15.815108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31194bd8-762a-4d82-a115-71e474ea9b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:15.815640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194bd8-762a-4d82-a115-71e474ea9b1d service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:15.815921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194bd8-762a-4d82-a115-71e474ea9b1d service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:15.816197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194bd8-762a-4d82-a115-71e474ea9b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:15.817818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-31194bd8-762a-4d82-a115-71e474ea9b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:15.867225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:15.909539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31194bd8-762a-4d82-a115-71e474ea9b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:15.911649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31194bd8-762a-4d82-a115-71e474ea9b1d service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:15.930733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 712/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:17.115482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb2ec8-217e-447b-8257-b0d6b3340271 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:17.116656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb2ec8-217e-447b-8257-b0d6b3340271 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:17.116656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb2ec8-217e-447b-8257-b0d6b3340271 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:17.118171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:17.125580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0585ae5-0ca5-46b6-bee4-6ba50c2e9e4d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:17.126164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0585ae5-0ca5-46b6-bee4-6ba50c2e9e4d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:17.126249 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0585ae5-0ca5-46b6-bee4-6ba50c2e9e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:17.208727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b0585ae5-0ca5-46b6-bee4-6ba50c2e9e4d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:17.210182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b0585ae5-0ca5-46b6-bee4-6ba50c2e9e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:17.319460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:17.484766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb2ec8-217e-447b-8257-b0d6b3340271 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:17.486357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b7eb2ec8-217e-447b-8257-b0d6b3340271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:17.539854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:17.641389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb2ec8-217e-447b-8257-b0d6b3340271 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:17.754062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce99a5d-f491-4cd7-bc4e-d71971eb2f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:17.754589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99a5d-f491-4cd7-bc4e-d71971eb2f2b service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:17.754866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99a5d-f491-4cd7-bc4e-d71971eb2f2b service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:17.755136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99a5d-f491-4cd7-bc4e-d71971eb2f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:17.756821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0ce99a5d-f491-4cd7-bc4e-d71971eb2f2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:17.764030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:17.848944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce99a5d-f491-4cd7-bc4e-d71971eb2f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:17.851446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce99a5d-f491-4cd7-bc4e-d71971eb2f2b service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:17.868991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 718/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:19.014980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8249c7-17af-41c7-a859-4bb2a9db5628 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:19.015550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8249c7-17af-41c7-a859-4bb2a9db5628 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:19.015550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8249c7-17af-41c7-a859-4bb2a9db5628 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:19.016941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:19.023584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cf27d-04fd-4c63-8ed2-4b83b8f942cf None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:19.024054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cf27d-04fd-4c63-8ed2-4b83b8f942cf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:19.024166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cf27d-04fd-4c63-8ed2-4b83b8f942cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:19.104304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-997cf27d-04fd-4c63-8ed2-4b83b8f942cf None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:19.105683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-997cf27d-04fd-4c63-8ed2-4b83b8f942cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:19.177526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:19.206579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:19.358749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8249c7-17af-41c7-a859-4bb2a9db5628 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:19.360191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3b8249c7-17af-41c7-a859-4bb2a9db5628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:19.377631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:19.508201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8249c7-17af-41c7-a859-4bb2a9db5628 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:19.595637 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:19.620827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19985974-1d7d-4a5f-ac5a-89b48aff55b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:19.621371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19985974-1d7d-4a5f-ac5a-89b48aff55b7 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:19.621729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19985974-1d7d-4a5f-ac5a-89b48aff55b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:19.621938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19985974-1d7d-4a5f-ac5a-89b48aff55b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:19.623576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-19985974-1d7d-4a5f-ac5a-89b48aff55b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:19.715992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19985974-1d7d-4a5f-ac5a-89b48aff55b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:19.717578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19985974-1d7d-4a5f-ac5a-89b48aff55b7 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:19.735696 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 715/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:20.862592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2ead-31f4-46a0-b14b-377cd865c751 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:20.863146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2ead-31f4-46a0-b14b-377cd865c751 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:20.863146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2ead-31f4-46a0-b14b-377cd865c751 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:20.864388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:20.871162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adabf3-dc7f-4ca6-979f-65998b290c75 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:20.871641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adabf3-dc7f-4ca6-979f-65998b290c75 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:20.871747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adabf3-dc7f-4ca6-979f-65998b290c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:20.947091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-25adabf3-dc7f-4ca6-979f-65998b290c75 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:20.948334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-25adabf3-dc7f-4ca6-979f-65998b290c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:20.988923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:21.043942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:21.197186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2ead-31f4-46a0-b14b-377cd865c751 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:21.198729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-292d2ead-31f4-46a0-b14b-377cd865c751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:21.345585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2ead-31f4-46a0-b14b-377cd865c751 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:21.400794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:21.460168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581b5ed-c12f-44a5-b935-4f26edcfb296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:21.460695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b5ed-c12f-44a5-b935-4f26edcfb296 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:21.460975 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b5ed-c12f-44a5-b935-4f26edcfb296 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:21.461240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581b5ed-c12f-44a5-b935-4f26edcfb296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:21.462869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6581b5ed-c12f-44a5-b935-4f26edcfb296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:21.555886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581b5ed-c12f-44a5-b935-4f26edcfb296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:21.557523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581b5ed-c12f-44a5-b935-4f26edcfb296 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:21.578543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 721/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:22.731671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea63bb-dcf8-4a5e-9c97-2fb1a6d3360d None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:22.732219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea63bb-dcf8-4a5e-9c97-2fb1a6d3360d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:22.732219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea63bb-dcf8-4a5e-9c97-2fb1a6d3360d None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:22.733586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:22.739925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65b0a-4b07-4878-b857-37fb5689cce9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:22.740385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65b0a-4b07-4878-b857-37fb5689cce9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:22.740480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65b0a-4b07-4878-b857-37fb5689cce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:22.815531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8aa65b0a-4b07-4878-b857-37fb5689cce9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:22.816737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8aa65b0a-4b07-4878-b857-37fb5689cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:22.819455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:22.913675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:23.071456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea63bb-dcf8-4a5e-9c97-2fb1a6d3360d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:23.072913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-29ea63bb-dcf8-4a5e-9c97-2fb1a6d3360d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:23.219096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea63bb-dcf8-4a5e-9c97-2fb1a6d3360d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:23.246984 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:23.332325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da9b12-080c-4c1b-834b-8cdb85d87d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:23.333113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9b12-080c-4c1b-834b-8cdb85d87d26 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:23.333388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9b12-080c-4c1b-834b-8cdb85d87d26 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:23.333655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9b12-080c-4c1b-834b-8cdb85d87d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:23.335571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-53da9b12-080c-4c1b-834b-8cdb85d87d26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:23.427374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da9b12-080c-4c1b-834b-8cdb85d87d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:23.429804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da9b12-080c-4c1b-834b-8cdb85d87d26 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:23.447355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 718/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:25.578301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98ca3-3753-49ab-8d76-e283668ac6d2 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:25.578841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98ca3-3753-49ab-8d76-e283668ac6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:25.578841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98ca3-3753-49ab-8d76-e283668ac6d2 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:25.580126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:25.585871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec56c31-cb17-4abb-9720-99cba1b4ae39 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:25.586313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec56c31-cb17-4abb-9720-99cba1b4ae39 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:25.586490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec56c31-cb17-4abb-9720-99cba1b4ae39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:25.627530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:25.652889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3ec56c31-cb17-4abb-9720-99cba1b4ae39 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:25.654162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3ec56c31-cb17-4abb-9720-99cba1b4ae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:25.753778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:26.050139 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d98ca3-3753-49ab-8d76-e283668ac6d2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:26.051699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c3d98ca3-3753-49ab-8d76-e283668ac6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:26.156119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d98ca3-3753-49ab-8d76-e283668ac6d2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:26.189591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:26.231371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0e9d8-b800-4203-894d-536cbaa20c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:26.231983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e9d8-b800-4203-894d-536cbaa20c21 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:26.232258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e9d8-b800-4203-894d-536cbaa20c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:26.232522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e9d8-b800-4203-894d-536cbaa20c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:26.234352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7ec0e9d8-b800-4203-894d-536cbaa20c21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:26.348904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0e9d8-b800-4203-894d-536cbaa20c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:26.350550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0e9d8-b800-4203-894d-536cbaa20c21 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:26.368597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 724/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:28.722556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e221-8804-45fe-975b-6b1c66db49c9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:28.723076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e221-8804-45fe-975b-6b1c66db49c9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:28.723076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e221-8804-45fe-975b-6b1c66db49c9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:28.724339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:28.729700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60d5b-fbe9-41c6-aa09-f1ead704705a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:28.730191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60d5b-fbe9-41c6-aa09-f1ead704705a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:28.730288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60d5b-fbe9-41c6-aa09-f1ead704705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:28.800959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-87b60d5b-fbe9-41c6-aa09-f1ead704705a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:28.802484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-87b60d5b-fbe9-41c6-aa09-f1ead704705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:28.817368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:28.919055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:29.246638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e221-8804-45fe-975b-6b1c66db49c9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:29.248275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4522e221-8804-45fe-975b-6b1c66db49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:29.362146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e221-8804-45fe-975b-6b1c66db49c9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:29.378789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:29.450414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54e487-5579-4051-bd2e-c36a44fdcda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:29.451030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54e487-5579-4051-bd2e-c36a44fdcda8 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:29.451311 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54e487-5579-4051-bd2e-c36a44fdcda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:29.451574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54e487-5579-4051-bd2e-c36a44fdcda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:29.453191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1f54e487-5579-4051-bd2e-c36a44fdcda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:29.575286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54e487-5579-4051-bd2e-c36a44fdcda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:29.576671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54e487-5579-4051-bd2e-c36a44fdcda8 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:29.596088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 721/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:32.132156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347558-6729-4210-972c-0cf7bc30d984 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:32.132739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347558-6729-4210-972c-0cf7bc30d984 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:32.132949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347558-6729-4210-972c-0cf7bc30d984 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:32.134194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:32.139636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe19b-1deb-4f26-9493-0f3a4cd23829 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:32.140099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe19b-1deb-4f26-9493-0f3a4cd23829 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:32.141899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebe19b-1deb-4f26-9493-0f3a4cd23829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:32.190188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:32.208316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c3ebe19b-1deb-4f26-9493-0f3a4cd23829 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:32.210232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c3ebe19b-1deb-4f26-9493-0f3a4cd23829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:32.308562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:33:32.599130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47347558-6729-4210-972c-0cf7bc30d984 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:32.600930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-47347558-6729-4210-972c-0cf7bc30d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:32.704699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47347558-6729-4210-972c-0cf7bc30d984 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:32.745581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:32.780303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071f66f-f0b1-4b43-9b33-218ac8035964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:32.780952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f66f-f0b1-4b43-9b33-218ac8035964 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:32.781288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f66f-f0b1-4b43-9b33-218ac8035964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:32.781553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f66f-f0b1-4b43-9b33-218ac8035964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:32.783194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2071f66f-f0b1-4b43-9b33-218ac8035964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:32.893690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071f66f-f0b1-4b43-9b33-218ac8035964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:32.895072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071f66f-f0b1-4b43-9b33-218ac8035964 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:32.915895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 727/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:35.220794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb900e0-baef-4a97-9ada-cf4069dda261 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:35.221383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb900e0-baef-4a97-9ada-cf4069dda261 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:35.221383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb900e0-baef-4a97-9ada-cf4069dda261 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:35.222757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:35.228074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f6d4-1a4d-42c9-a43a-922f908a003c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:35.228514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f6d4-1a4d-42c9-a43a-922f908a003c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:35.228626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f6d4-1a4d-42c9-a43a-922f908a003c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:35.417505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-faf0f6d4-1a4d-42c9-a43a-922f908a003c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:35.418741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-faf0f6d4-1a4d-42c9-a43a-922f908a003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:35.443625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:35.524031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:35.807979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb900e0-baef-4a97-9ada-cf4069dda261 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:35.809592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3eb900e0-baef-4a97-9ada-cf4069dda261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:35.914998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb900e0-baef-4a97-9ada-cf4069dda261 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:35.938035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:35.992673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84312229-9534-463b-bf5d-0d0de90884dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:35.993283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84312229-9534-463b-bf5d-0d0de90884dd service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:35.993566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84312229-9534-463b-bf5d-0d0de90884dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:35.993837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84312229-9534-463b-bf5d-0d0de90884dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:35.995508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-84312229-9534-463b-bf5d-0d0de90884dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:36.110896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84312229-9534-463b-bf5d-0d0de90884dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:36.112315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84312229-9534-463b-bf5d-0d0de90884dd service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:36.133649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 724/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:38.359594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17570cd4-2d7d-43fc-a78b-0493c93970bb None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:38.360161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17570cd4-2d7d-43fc-a78b-0493c93970bb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:38.360161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17570cd4-2d7d-43fc-a78b-0493c93970bb None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:38.361452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:38.367615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f148b4-7f31-4c46-935d-2cf0bfa16f8a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:38.368034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f148b4-7f31-4c46-935d-2cf0bfa16f8a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:38.368168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f148b4-7f31-4c46-935d-2cf0bfa16f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:38.432497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:38.435282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-03f148b4-7f31-4c46-935d-2cf0bfa16f8a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:38.436505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-03f148b4-7f31-4c46-935d-2cf0bfa16f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:38.532909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:38.822358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17570cd4-2d7d-43fc-a78b-0493c93970bb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:38.823908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-17570cd4-2d7d-43fc-a78b-0493c93970bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:38.931661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17570cd4-2d7d-43fc-a78b-0493c93970bb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:38.981932 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:39.005479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96c974-ecc3-46a3-99ac-87f39422f998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:39.006114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c974-ecc3-46a3-99ac-87f39422f998 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:39.006423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c974-ecc3-46a3-99ac-87f39422f998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:39.006852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c974-ecc3-46a3-99ac-87f39422f998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:39.008471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fe96c974-ecc3-46a3-99ac-87f39422f998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:39.121300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96c974-ecc3-46a3-99ac-87f39422f998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:39.122666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96c974-ecc3-46a3-99ac-87f39422f998 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:39.141371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 730/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:41.402116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeace9-2930-4e65-a242-f93f48832ab9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:41.402910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeace9-2930-4e65-a242-f93f48832ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:41.402910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeace9-2930-4e65-a242-f93f48832ab9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:41.404194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:41.409590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbbc55-4c74-40e4-acdd-e87b54e6084b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:41.410071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbbc55-4c74-40e4-acdd-e87b54e6084b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:41.410209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbbc55-4c74-40e4-acdd-e87b54e6084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:41.478047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-babbbc55-4c74-40e4-acdd-e87b54e6084b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:41.479268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-babbbc55-4c74-40e4-acdd-e87b54e6084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:41.509363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:41.576653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:41.884273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aeace9-2930-4e65-a242-f93f48832ab9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:41.885829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-51aeace9-2930-4e65-a242-f93f48832ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:41.988322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aeace9-2930-4e65-a242-f93f48832ab9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:42.016515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:42.062878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e3f58-3d98-46e6-b837-62478f3461b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:42.063480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3f58-3d98-46e6-b837-62478f3461b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:42.063764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3f58-3d98-46e6-b837-62478f3461b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:42.064031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e3f58-3d98-46e6-b837-62478f3461b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:42.065649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-279e3f58-3d98-46e6-b837-62478f3461b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:42.176384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e3f58-3d98-46e6-b837-62478f3461b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:42.177737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e3f58-3d98-46e6-b837-62478f3461b7 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:42.196216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 727/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:44.549451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7d2f5-ebaa-49f9-9eba-7914b4973d59 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:44.550001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7d2f5-ebaa-49f9-9eba-7914b4973d59 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:44.550001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7d2f5-ebaa-49f9-9eba-7914b4973d59 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:44.551319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:44.556924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f840a-d5ed-4184-9f9e-ba74383a938d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:44.557391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f840a-d5ed-4184-9f9e-ba74383a938d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:44.557496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f840a-d5ed-4184-9f9e-ba74383a938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:44.630123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b23f840a-d5ed-4184-9f9e-ba74383a938d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:44.631992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b23f840a-d5ed-4184-9f9e-ba74383a938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:44.640713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:44.731330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:45.017123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7d2f5-ebaa-49f9-9eba-7914b4973d59 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:45.018693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-67e7d2f5-ebaa-49f9-9eba-7914b4973d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:45.123235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7d2f5-ebaa-49f9-9eba-7914b4973d59 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:45.180355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:45.199738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecf381-2385-4869-be59-f79161c87237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:45.200376 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf381-2385-4869-be59-f79161c87237 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:45.200653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf381-2385-4869-be59-f79161c87237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:45.200921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf381-2385-4869-be59-f79161c87237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:45.202550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-eaecf381-2385-4869-be59-f79161c87237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:45.314159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecf381-2385-4869-be59-f79161c87237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:45.315488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecf381-2385-4869-be59-f79161c87237 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:45.333914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 733/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:47.567040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb79cf-4972-4b9a-ac91-768cbdf1b589 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:47.567618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb79cf-4972-4b9a-ac91-768cbdf1b589 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:47.567618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb79cf-4972-4b9a-ac91-768cbdf1b589 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:47.568943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:47.574666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb03c1-6169-4d63-abba-1841a1470b3c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:47.575100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb03c1-6169-4d63-abba-1841a1470b3c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:47.575250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb03c1-6169-4d63-abba-1841a1470b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:47.644307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0dcb03c1-6169-4d63-abba-1841a1470b3c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:47.645569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0dcb03c1-6169-4d63-abba-1841a1470b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:47.685687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:47.744902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:33:48.029460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb79cf-4972-4b9a-ac91-768cbdf1b589 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:48.031132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-64eb79cf-4972-4b9a-ac91-768cbdf1b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:48.138484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb79cf-4972-4b9a-ac91-768cbdf1b589 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:48.184664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:48.220428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0b8c1-b799-44f6-b740-4609ad477251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:48.221245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b8c1-b799-44f6-b740-4609ad477251 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:48.221537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b8c1-b799-44f6-b740-4609ad477251 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:48.221804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0b8c1-b799-44f6-b740-4609ad477251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:48.223439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fdc0b8c1-b799-44f6-b740-4609ad477251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:48.333492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0b8c1-b799-44f6-b740-4609ad477251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:48.335163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0b8c1-b799-44f6-b740-4609ad477251 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:48.355232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 730/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:50.552542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7de42-ef98-455c-a7d6-6c3820779e97 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:50.553669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7de42-ef98-455c-a7d6-6c3820779e97 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:50.553669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7de42-ef98-455c-a7d6-6c3820779e97 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:50.555008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:33:50.560477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11ba28-fa00-409d-9928-557b3accb8af None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:50.560911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11ba28-fa00-409d-9928-557b3accb8af None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:50.561014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11ba28-fa00-409d-9928-557b3accb8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:50.630396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ae11ba28-fa00-409d-9928-557b3accb8af None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:50.631807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ae11ba28-fa00-409d-9928-557b3accb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:50.650731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:50.729102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:51.031793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7de42-ef98-455c-a7d6-6c3820779e97 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:51.033396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-43d7de42-ef98-455c-a7d6-6c3820779e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:51.139888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7de42-ef98-455c-a7d6-6c3820779e97 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:51.218379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:51.224790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c313dc-84b1-477e-ba7a-096341b9a90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:51.225534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c313dc-84b1-477e-ba7a-096341b9a90b service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:51.225814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c313dc-84b1-477e-ba7a-096341b9a90b service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:51.226114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c313dc-84b1-477e-ba7a-096341b9a90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:51.227736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e3c313dc-84b1-477e-ba7a-096341b9a90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:51.338015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c313dc-84b1-477e-ba7a-096341b9a90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:51.339366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c313dc-84b1-477e-ba7a-096341b9a90b service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:51.357178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 736/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:33:53.554577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ef46f-6a9d-4e71-bcd8-747b6b7d7252 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:53.555149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ef46f-6a9d-4e71-bcd8-747b6b7d7252 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:53.555149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ef46f-6a9d-4e71-bcd8-747b6b7d7252 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:53.556355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:33:53.562259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e80fc9-f24d-470f-b1a5-fdf87f07b21a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:53.562693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e80fc9-f24d-470f-b1a5-fdf87f07b21a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:53.562804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e80fc9-f24d-470f-b1a5-fdf87f07b21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:53.633147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-02e80fc9-f24d-470f-b1a5-fdf87f07b21a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:33:53.634507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-02e80fc9-f24d-470f-b1a5-fdf87f07b21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:53.686083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:53.734724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:33:54.017447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ef46f-6a9d-4e71-bcd8-747b6b7d7252 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:33:54.019051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-264ef46f-6a9d-4e71-bcd8-747b6b7d7252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:54.129064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ef46f-6a9d-4e71-bcd8-747b6b7d7252 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:33:54.179472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:33:54.205789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b63a47-4e72-4ed8-8830-8fc3d9b4a6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:33:54.206433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b63a47-4e72-4ed8-8830-8fc3d9b4a6ec service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:33:54.206967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b63a47-4e72-4ed8-8830-8fc3d9b4a6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:33:54.207237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b63a47-4e72-4ed8-8830-8fc3d9b4a6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:33:54.208880 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d6b63a47-4e72-4ed8-8830-8fc3d9b4a6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:33:54.323932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b63a47-4e72-4ed8-8830-8fc3d9b4a6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:33:54.325353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b63a47-4e72-4ed8-8830-8fc3d9b4a6ec service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:33:54.343648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 733/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:34:03.733180 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=22 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:04.341374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=66 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:14.566304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea7d6-d589-467b-a974-dbe32073882c None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:14.566865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea7d6-d589-467b-a974-dbe32073882c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:14.566865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea7d6-d589-467b-a974-dbe32073882c None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:14.568811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 738/1471] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:34:14.574316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094fbe-0ffc-48fc-8817-2f1d71958691 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:14.574764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094fbe-0ffc-48fc-8817-2f1d71958691 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:14.574864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094fbe-0ffc-48fc-8817-2f1d71958691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:14.650403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-50094fbe-0ffc-48fc-8817-2f1d71958691 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:34:14.651624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-50094fbe-0ffc-48fc-8817-2f1d71958691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:14.752220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 734/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:34:15.050061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919378c-8561-4247-a516-a01be7ccbcab None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:15.050347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919378c-8561-4247-a516-a01be7ccbcab None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:15.050617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919378c-8561-4247-a516-a01be7ccbcab None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:15.051936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 739/1473] 10.222.0.16 () {54 vars in 962 bytes} [Thu Sep 22 14:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:34:15.057537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1043cf-28d4-41ae-8053-db19ede376ef None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:15.057828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1043cf-28d4-41ae-8053-db19ede376ef None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:15.058133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1043cf-28d4-41ae-8053-db19ede376ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:15.142289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ee1043cf-28d4-41ae-8053-db19ede376ef None None] MFA Rules not processed for user `71dca3ee8b78402eb95815eb200d90a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:34:15.143520 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ee1043cf-28d4-41ae-8053-db19ede376ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:15.165947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:15.224884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 735/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Sep 22 14:34:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:34:15.232435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919378c-8561-4247-a516-a01be7ccbcab None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:34:15.233957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b919378c-8561-4247-a516-a01be7ccbcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:15.344595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919378c-8561-4247-a516-a01be7ccbcab None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:34:15.422841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca8f33-546b-4d8f-9808-ae3cae756df1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dca3ee8b78402eb95815eb200d90a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:34:15.423473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8f33-546b-4d8f-9808-ae3cae756df1 service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:15.423746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8f33-546b-4d8f-9808-ae3cae756df1 service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:15.424011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8f33-546b-4d8f-9808-ae3cae756df1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:15.425659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-02ca8f33-546b-4d8f-9808-ae3cae756df1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:15.483573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:15.541102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca8f33-546b-4d8f-9808-ae3cae756df1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:34:15.544459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca8f33-546b-4d8f-9808-ae3cae756df1 service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:34:15.562888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 740/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:34:17.870943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8087-c95e-43d5-a597-15103e4c7115 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:17.871503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8087-c95e-43d5-a597-15103e4c7115 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:17.871503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8087-c95e-43d5-a597-15103e4c7115 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:17.872817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 736/1476] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:34:17.878397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c4a13-240b-48d1-a664-6df1f59f8697 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:17.878843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c4a13-240b-48d1-a664-6df1f59f8697 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:17.878947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c4a13-240b-48d1-a664-6df1f59f8697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:17.955432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-479c4a13-240b-48d1-a664-6df1f59f8697 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:34:17.956934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-479c4a13-240b-48d1-a664-6df1f59f8697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:18.060941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 741/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:34:18.340809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8087-c95e-43d5-a597-15103e4c7115 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:34:18.342415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-00ab8087-c95e-43d5-a597-15103e4c7115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:18.484288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab8087-c95e-43d5-a597-15103e4c7115 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:34:18.542528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:18.589777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d8f43-a76a-40b2-b8b1-f42fb9f41f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:34:18.590438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d8f43-a76a-40b2-b8b1-f42fb9f41f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:18.590716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d8f43-a76a-40b2-b8b1-f42fb9f41f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:18.590989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d8f43-a76a-40b2-b8b1-f42fb9f41f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:18.591628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d8f43-a76a-40b2-b8b1-f42fb9f41f21 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:34:18.593573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-080d8f43-a76a-40b2-b8b1-f42fb9f41f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:34:18.593573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: warnings.warn(msg) Sep 22 14:34:18.593573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: Sep 22 14:34:18.594714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d8f43-a76a-40b2-b8b1-f42fb9f41f21 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:34:18.617474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 737/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 22 14:34:18 2022] GET /identity/v3/projects => generated 2553 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:34:20.839605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb2f81-5094-440b-89a0-e8da61423d73 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:20.840167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb2f81-5094-440b-89a0-e8da61423d73 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:20.840167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb2f81-5094-440b-89a0-e8da61423d73 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:20.841496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 742/1479] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:34:20.847237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12520-9581-464c-9073-b7949617737d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:20.847676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12520-9581-464c-9073-b7949617737d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:20.847783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f12520-9581-464c-9073-b7949617737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:20.919839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-40f12520-9581-464c-9073-b7949617737d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:34:20.921092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-40f12520-9581-464c-9073-b7949617737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:21.031807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 738/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:34:21.352399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb2f81-5094-440b-89a0-e8da61423d73 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:34:21.353964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-63bb2f81-5094-440b-89a0-e8da61423d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:21.363891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:21.518291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb2f81-5094-440b-89a0-e8da61423d73 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:34:21.606675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:21.640836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f0ad7-d2b6-44b0-9cd8-69c52abcca82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:34:21.641477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f0ad7-d2b6-44b0-9cd8-69c52abcca82 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:21.641753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f0ad7-d2b6-44b0-9cd8-69c52abcca82 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:21.642055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f0ad7-d2b6-44b0-9cd8-69c52abcca82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:21.643695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0d9f0ad7-d2b6-44b0-9cd8-69c52abcca82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:21.743235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f0ad7-d2b6-44b0-9cd8-69c52abcca82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:34:21.744872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f0ad7-d2b6-44b0-9cd8-69c52abcca82 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:34:21.764202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 743/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:34:24.159750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797022c-d66f-4385-b07c-9709d4d5353c None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:24.160331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797022c-d66f-4385-b07c-9709d4d5353c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:24.160331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797022c-d66f-4385-b07c-9709d4d5353c None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:24.162320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 739/1482] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:34:24.167642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6093a-9ea9-46fd-a056-131ecf2acfda None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:24.168118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6093a-9ea9-46fd-a056-131ecf2acfda None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:24.168274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6093a-9ea9-46fd-a056-131ecf2acfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:24.235049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e2b6093a-9ea9-46fd-a056-131ecf2acfda None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:34:24.236275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e2b6093a-9ea9-46fd-a056-131ecf2acfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:24.282827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:24.334766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 744/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:34:24.624377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797022c-d66f-4385-b07c-9709d4d5353c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:34:24.626030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e797022c-d66f-4385-b07c-9709d4d5353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:24.651850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:24.731015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797022c-d66f-4385-b07c-9709d4d5353c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:34:24.804103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb343ae9-bd4e-4985-bccc-774eb3c35084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:34:24.804629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb343ae9-bd4e-4985-bccc-774eb3c35084 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:24.804905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb343ae9-bd4e-4985-bccc-774eb3c35084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:24.805177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb343ae9-bd4e-4985-bccc-774eb3c35084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:24.806822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bb343ae9-bd4e-4985-bccc-774eb3c35084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:24.880810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:24.916663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb343ae9-bd4e-4985-bccc-774eb3c35084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:34:24.918160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb343ae9-bd4e-4985-bccc-774eb3c35084 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:34:24.936450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 740/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:34:27.172168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6b53e-a2d8-4fc8-a9a8-daf459b9348f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:27.172750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6b53e-a2d8-4fc8-a9a8-daf459b9348f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:27.172750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6b53e-a2d8-4fc8-a9a8-daf459b9348f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:27.174119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 745/1485] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:34:27.180113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687714-c88a-4904-8c84-b8a0cef87e38 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:27.180573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687714-c88a-4904-8c84-b8a0cef87e38 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:27.180686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc687714-c88a-4904-8c84-b8a0cef87e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:27.363285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fc687714-c88a-4904-8c84-b8a0cef87e38 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:34:27.365211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fc687714-c88a-4904-8c84-b8a0cef87e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:27.464266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 741/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:34:27.752598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6b53e-a2d8-4fc8-a9a8-daf459b9348f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:34:27.754168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a3a6b53e-a2d8-4fc8-a9a8-daf459b9348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:27.858726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6b53e-a2d8-4fc8-a9a8-daf459b9348f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:34:27.931901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:27.933384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4b90d-e268-49ba-af7e-2df2ebacaaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:34:27.934011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4b90d-e268-49ba-af7e-2df2ebacaaaa service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:27.934291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4b90d-e268-49ba-af7e-2df2ebacaaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:27.934566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4b90d-e268-49ba-af7e-2df2ebacaaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:27.936171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4ff4b90d-e268-49ba-af7e-2df2ebacaaaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:28.046323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4b90d-e268-49ba-af7e-2df2ebacaaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:34:28.047654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4b90d-e268-49ba-af7e-2df2ebacaaaa service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:34:28.065145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 746/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:34:30.354667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a1ec-eb9b-4caf-ac93-b5f5e80fe0c4 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:30.355203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a1ec-eb9b-4caf-ac93-b5f5e80fe0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:30.355203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963a1ec-eb9b-4caf-ac93-b5f5e80fe0c4 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:30.356565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 742/1488] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:34:30.362104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d28c-8cf4-4e23-a83d-55b918debd78 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:30.362633 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d28c-8cf4-4e23-a83d-55b918debd78 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:30.362739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333d28c-8cf4-4e23-a83d-55b918debd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:30.446890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5333d28c-8cf4-4e23-a83d-55b918debd78 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:34:30.448199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5333d28c-8cf4-4e23-a83d-55b918debd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:30.504953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:30.549007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 747/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:34:30.842742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a1ec-eb9b-4caf-ac93-b5f5e80fe0c4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:34:30.844331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7963a1ec-eb9b-4caf-ac93-b5f5e80fe0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:30.881505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:30.949603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963a1ec-eb9b-4caf-ac93-b5f5e80fe0c4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:34:31.024332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb8aa6-5a8d-4daf-b4f8-1dc6b0104c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:34:31.024937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8aa6-5a8d-4daf-b4f8-1dc6b0104c08 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:31.025217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8aa6-5a8d-4daf-b4f8-1dc6b0104c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:31.025482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb8aa6-5a8d-4daf-b4f8-1dc6b0104c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:31.027131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dbbb8aa6-5a8d-4daf-b4f8-1dc6b0104c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:31.109396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:31.139112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb8aa6-5a8d-4daf-b4f8-1dc6b0104c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:34:31.140577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb8aa6-5a8d-4daf-b4f8-1dc6b0104c08 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:34:31.159055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 743/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:34:33.799898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a771-0a21-4780-8a74-4fb6e31887b9 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:33.800476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a771-0a21-4780-8a74-4fb6e31887b9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:33.800476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a771-0a21-4780-8a74-4fb6e31887b9 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:33.801774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 748/1491] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 22 14:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:34:33.808862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4e50-c27b-46b2-a60e-a8d8b2264b0a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:33.809285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4e50-c27b-46b2-a60e-a8d8b2264b0a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:33.809414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4e50-c27b-46b2-a60e-a8d8b2264b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:33.875403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f9fb4e50-c27b-46b2-a60e-a8d8b2264b0a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:34:33.876709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f9fb4e50-c27b-46b2-a60e-a8d8b2264b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:33.973844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 744/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 22 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:34:34.265211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72a771-0a21-4780-8a74-4fb6e31887b9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:34:34.266799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8c72a771-0a21-4780-8a74-4fb6e31887b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:34.371063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72a771-0a21-4780-8a74-4fb6e31887b9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:34:34.444481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69aef42-7c5b-40f3-ab9e-ab763cc3b4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:34:34.445125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aef42-7c5b-40f3-ab9e-ab763cc3b4ac service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:34:34.445403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aef42-7c5b-40f3-ab9e-ab763cc3b4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:34:34.445669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69aef42-7c5b-40f3-ab9e-ab763cc3b4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:34:34.447290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e69aef42-7c5b-40f3-ab9e-ab763cc3b4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:34:34.455984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:34.556448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aef42-7c5b-40f3-ab9e-ab763cc3b4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:34:34.557877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69aef42-7c5b-40f3-ab9e-ab763cc3b4ac service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:34:34.575620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 749/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:34:43.972266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=82 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:34:44.573354 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=50 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:35:58.046255 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6efe92-0d53-4bd7-86de-37d0cd8c3da5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:58.046903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6efe92-0d53-4bd7-86de-37d0cd8c3da5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:58.046903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6efe92-0d53-4bd7-86de-37d0cd8c3da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:58.124377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-aa6efe92-0d53-4bd7-86de-37d0cd8c3da5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:35:58.125638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-aa6efe92-0d53-4bd7-86de-37d0cd8c3da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:58.227114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 745/1494] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:35:58.235770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7aca-6e7f-42ef-930a-69a52746fb78 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:58.236277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7aca-6e7f-42ef-930a-69a52746fb78 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:58.236393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f7aca-6e7f-42ef-930a-69a52746fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:58.313776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b66f7aca-6e7f-42ef-930a-69a52746fb78 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:35:58.314973 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b66f7aca-6e7f-42ef-930a-69a52746fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:58.410538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 750/1495] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:35:58.415895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6efe92-0d53-4bd7-86de-37d0cd8c3da5 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:35:58.417095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-aa6efe92-0d53-4bd7-86de-37d0cd8c3da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:58.428389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6efe92-0d53-4bd7-86de-37d0cd8c3da5 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:35:58.493282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:35:58.527125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:35:58.527735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:58.528010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:58.528278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:58.528913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:35:58.529211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:35:58.530253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:35:58.530253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: warnings.warn(msg) Sep 22 14:35:58.530253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: Sep 22 14:35:58.531123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:35:58.543070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 746/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:35:58.551264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f7aca-6e7f-42ef-930a-69a52746fb78 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:35:58.561408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f7aca-6e7f-42ef-930a-69a52746fb78 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:35:58.624487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:35:58.658563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:35:58.659169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:58.659444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:58.659708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:58.660329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:35:58.662077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:35:58.662077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 22 14:35:58.662077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: Sep 22 14:35:58.663499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:35:58.813096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 751/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:35:58 2022] POST /identity/v3/projects => generated 377 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:35:58.817434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:35:58.819000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:58.854864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b44a78-572e-48e4-bb9c-9b9381daa042 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:35:58.951612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:35:58.952160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:58.952444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:58.952737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:58.953621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:35:58.954663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:35:58.954663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: warnings.warn(msg) Sep 22 14:35:58.954663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: Sep 22 14:35:58.955851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:35:59.070406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 747/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:35:58 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:35:59.075499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:35:59.077088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:59.138961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cac012-f022-4230-84f1-9abc20f4ecd1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:35:59.223833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:35:59.234976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:35:59.235588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:59.235867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:59.236407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:59.236768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:35:59.237779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:35:59.237779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 22 14:35:59.237779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: Sep 22 14:35:59.238702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:35:59.253236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 752/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:35:59.257125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:35:59.259353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:59.270990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810355-6090-463b-8787-7d966d6c0794 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:35:59.296675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:35:59.366150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1705ff8-fc3a-446f-83c5-4e1e67f1a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:35:59.366749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1705ff8-fc3a-446f-83c5-4e1e67f1a8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:59.367021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1705ff8-fc3a-446f-83c5-4e1e67f1a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:59.367282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1705ff8-fc3a-446f-83c5-4e1e67f1a8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:59.367917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1705ff8-fc3a-446f-83c5-4e1e67f1a8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:35:59.368916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-c1705ff8-fc3a-446f-83c5-4e1e67f1a8b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:35:59.368916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: warnings.warn(msg) Sep 22 14:35:59.368916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: Sep 22 14:35:59.369785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1705ff8-fc3a-446f-83c5-4e1e67f1a8b0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:35:59.382072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 748/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:35:59.386779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:35:59.388338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:59.421170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35093308-bdee-4ca9-9c0d-b31ef2abad6c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:35:59.519104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27250684-81d6-40b0-88ae-c5d02265fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:35:59.519758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250684-81d6-40b0-88ae-c5d02265fdc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:59.520033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250684-81d6-40b0-88ae-c5d02265fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:59.520300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250684-81d6-40b0-88ae-c5d02265fdc7 admin admin] PATH_INFO: `/v3/projects/1c771e9f0cf1430ca7be7e392697acd2/users/6194e73d89804e6b98091ea122f761ec/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:59.546025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27250684-81d6-40b0-88ae-c5d02265fdc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c771e9f0cf1430ca7be7e392697acd2, user_id=6194e73d89804e6b98091ea122f761ec, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:35:59.547129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-27250684-81d6-40b0-88ae-c5d02265fdc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:35:59.547129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 22 14:35:59.547129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: Sep 22 14:35:59.549108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27250684-81d6-40b0-88ae-c5d02265fdc7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:35:59.638448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 753/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:35:59 2022] PUT /identity/v3/projects/1c771e9f0cf1430ca7be7e392697acd2/users/6194e73d89804e6b98091ea122f761ec/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:35:59.651111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ec1c-50cf-46e0-9075-e0435c2c7ed4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:59.651400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ec1c-50cf-46e0-9075-e0435c2c7ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:59.651677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66ec1c-50cf-46e0-9075-e0435c2c7ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:59.709806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1f66ec1c-50cf-46e0-9075-e0435c2c7ed4 None None] MFA Rules not processed for user `6194e73d89804e6b98091ea122f761ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:35:59.711105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1f66ec1c-50cf-46e0-9075-e0435c2c7ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:59.790926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 749/1502] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:35:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:35:59.804075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bfc3-0917-495f-9bb1-1d6076fed034 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:59.804364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bfc3-0917-495f-9bb1-1d6076fed034 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:59.804639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bfc3-0917-495f-9bb1-1d6076fed034 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:59.806585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 754/1503] 10.222.0.16 () {54 vars in 963 bytes} [Thu Sep 22 14:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:35:59.811618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea32d-60cb-4217-9aa4-2b10e5c85eeb None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:35:59.811905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea32d-60cb-4217-9aa4-2b10e5c85eeb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:35:59.812179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea32d-60cb-4217-9aa4-2b10e5c85eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:35:59.843703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:35:59.892342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6c1ea32d-60cb-4217-9aa4-2b10e5c85eeb None None] MFA Rules not processed for user `58f40fbc281849418ef9d4c75562c56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:35:59.893639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6c1ea32d-60cb-4217-9aa4-2b10e5c85eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:35:59.973298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 750/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Sep 22 14:35:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:35:59.984275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5bfc3-0917-495f-9bb1-1d6076fed034 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:35:59.985810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-76e5bfc3-0917-495f-9bb1-1d6076fed034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:36:00.035226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:36:00.088364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5bfc3-0917-495f-9bb1-1d6076fed034 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:36:00.163293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:36:00.163903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:36:00.164178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:36:00.164640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:36:00.166276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:36:00.272832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:36:00.274394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:36:00.277839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:36:00.292113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 755/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:35:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:36:00.339473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72572-1c9d-4698-b2de-eb5b5b8471bc None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:36:00.339908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72572-1c9d-4698-b2de-eb5b5b8471bc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:36:00.340030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72572-1c9d-4698-b2de-eb5b5b8471bc None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:36:00.341197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 751/1506] 10.222.0.16 () {52 vars in 830 bytes} [Thu Sep 22 14:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:36:00.344818 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:36:00.346067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:36:00.448809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac0f7-b79d-4442-86ad-30b8d6e59dea service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:36:00.556662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:36:00.557284 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:36:00.557566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:36:00.557841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] PATH_INFO: `/v3/users/6194e73d89804e6b98091ea122f761ec` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:36:00.572039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6194e73d89804e6b98091ea122f761ec)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:36:00.573070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:36:00.573070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 22 14:36:00.573070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: Sep 22 14:36:00.574341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:36:00.584750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:36:00.760071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6194e73d89804e6b98091ea122f761ec'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:00.783120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6194e73d89804e6b98091ea122f761ec'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:00.916153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6194e73d89804e6b98091ea122f761ec'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:00.916596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6194e73d89804e6b98091ea122f761ec'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:00.931949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6194e73d89804e6b98091ea122f761ec'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:00.937686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 756/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:36:00 2022] DELETE /identity/v3/users/6194e73d89804e6b98091ea122f761ec => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:36:00.942147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968704b-fa51-4385-93b2-d89f1245510c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:36:00.942421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968704b-fa51-4385-93b2-d89f1245510c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:36:00.942698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968704b-fa51-4385-93b2-d89f1245510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:36:01.000530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5968704b-fa51-4385-93b2-d89f1245510c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:36:01.001757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5968704b-fa51-4385-93b2-d89f1245510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:36:01.078676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:36:01.090722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 752/1508] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:36:01.100389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:36:01.101620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:36:01.202817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6596ff0-45fd-4fe7-b0e7-9ce1ac6ab73d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:36:01.264314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:36:01.285961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4741f8b-9eef-44e2-9bd6-f8df07844281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:36:01.286649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4741f8b-9eef-44e2-9bd6-f8df07844281 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:36:01.286867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4741f8b-9eef-44e2-9bd6-f8df07844281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:36:01.287134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4741f8b-9eef-44e2-9bd6-f8df07844281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:36:01.290191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e4741f8b-9eef-44e2-9bd6-f8df07844281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:36:01.400252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4741f8b-9eef-44e2-9bd6-f8df07844281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:36:01.401625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4741f8b-9eef-44e2-9bd6-f8df07844281 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:36:01.421260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 757/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:36:01.951835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968704b-fa51-4385-93b2-d89f1245510c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:36:01.953077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5968704b-fa51-4385-93b2-d89f1245510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:36:01.965423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968704b-fa51-4385-93b2-d89f1245510c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:36:02.065601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:36:02.066277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:36:02.066555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:36:02.066826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] PATH_INFO: `/v3/projects/1c771e9f0cf1430ca7be7e392697acd2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:36:02.077385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c771e9f0cf1430ca7be7e392697acd2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:36:02.078720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:36:02.078720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: warnings.warn(msg) Sep 22 14:36:02.078720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: Sep 22 14:36:02.080084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:36:02.208739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c771e9f0cf1430ca7be7e392697acd2', 'request_id': 'req-2841e562-f99e-489e-87ed-5dc5a2aa253f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:02.286156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c771e9f0cf1430ca7be7e392697acd2', 'request_id': 'req-2841e562-f99e-489e-87ed-5dc5a2aa253f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:02.302604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c771e9f0cf1430ca7be7e392697acd2', 'request_id': 'req-2841e562-f99e-489e-87ed-5dc5a2aa253f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:02.327889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] The token cache is being invalidate because project 1c771e9f0cf1430ca7be7e392697acd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:36:02.328691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:02.329008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2841e562-f99e-489e-87ed-5dc5a2aa253f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:36:02.330362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 753/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:36:01 2022] DELETE /identity/v3/projects/1c771e9f0cf1430ca7be7e392697acd2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:36:11.419238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=62 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:36:12.325838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:37:40.280307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efaba8-a032-44e7-8d96-d4b83a7c1783 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:40.280976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efaba8-a032-44e7-8d96-d4b83a7c1783 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:40.280976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efaba8-a032-44e7-8d96-d4b83a7c1783 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:40.282430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:37:40.287712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f154-cd1d-4291-a0f4-ac406212aca9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:40.288218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f154-cd1d-4291-a0f4-ac406212aca9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:40.288323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f154-cd1d-4291-a0f4-ac406212aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:40.372300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-60c5f154-cd1d-4291-a0f4-ac406212aca9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:37:40.373567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-60c5f154-cd1d-4291-a0f4-ac406212aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:40.483131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:37:40.648876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efaba8-a032-44e7-8d96-d4b83a7c1783 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:37:40.651199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c9efaba8-a032-44e7-8d96-d4b83a7c1783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:40.796153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efaba8-a032-44e7-8d96-d4b83a7c1783 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:37:40.802522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d40242-0916-4c20-a033-54e2e4212b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:37:40.803145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d40242-0916-4c20-a033-54e2e4212b62 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:40.803428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d40242-0916-4c20-a033-54e2e4212b62 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:40.803728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d40242-0916-4c20-a033-54e2e4212b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:40.812576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d40242-0916-4c20-a033-54e2e4212b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:37:40.814216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d40242-0916-4c20-a033-54e2e4212b62 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:37:40.824984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 759/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:37:41.949965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43b22f-7af7-48d0-977f-f79a9e569464 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:41.950837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43b22f-7af7-48d0-977f-f79a9e569464 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:41.950837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43b22f-7af7-48d0-977f-f79a9e569464 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:41.952170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:37:41.962427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567acb-4b21-41bf-b403-0dca7325e2e8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:41.962993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567acb-4b21-41bf-b403-0dca7325e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:41.963102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567acb-4b21-41bf-b403-0dca7325e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:41.984730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-87567acb-4b21-41bf-b403-0dca7325e2e8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:37:41.987240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-87567acb-4b21-41bf-b403-0dca7325e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:41.998174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:37:42.156509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43b22f-7af7-48d0-977f-f79a9e569464 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:37:42.172201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43b22f-7af7-48d0-977f-f79a9e569464 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:37:42.178528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15a19a-a2fd-4b7a-9f45-8d608124a798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:37:42.179187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a19a-a2fd-4b7a-9f45-8d608124a798 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:42.179464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a19a-a2fd-4b7a-9f45-8d608124a798 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:42.179735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a19a-a2fd-4b7a-9f45-8d608124a798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:42.188628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15a19a-a2fd-4b7a-9f45-8d608124a798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:37:42.190317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15a19a-a2fd-4b7a-9f45-8d608124a798 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:37:42.201002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 756/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:37:43.161990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad27f5f-0dc4-4105-8199-8c1b20826063 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:43.162591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad27f5f-0dc4-4105-8199-8c1b20826063 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:43.162591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad27f5f-0dc4-4105-8199-8c1b20826063 None None] PATH_INFO: `/v3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:43.163870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 761/1517] 10.222.0.60 () {54 vars in 925 bytes} [Thu Sep 22 14:37:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:37:43.176711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d77124-f2a8-4a9f-9b9e-fec23ffffde2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:43.177225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d77124-f2a8-4a9f-9b9e-fec23ffffde2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:43.177225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d77124-f2a8-4a9f-9b9e-fec23ffffde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:43.245411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-71d77124-f2a8-4a9f-9b9e-fec23ffffde2 None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:37:43.246699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-71d77124-f2a8-4a9f-9b9e-fec23ffffde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:43.265126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:37:43.324343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 757/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Thu Sep 22 14:37:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:37:47.429227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d61ac-622f-4e16-acbc-537cd0717db3 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:47.429812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d61ac-622f-4e16-acbc-537cd0717db3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:47.429812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d61ac-622f-4e16-acbc-537cd0717db3 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:47.431131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 762/1519] 10.222.0.16 () {54 vars in 961 bytes} [Thu Sep 22 14:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:37:47.438784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93ba7-2b33-4008-8376-4d55d3ae9ce1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:47.439301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93ba7-2b33-4008-8376-4d55d3ae9ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:47.439301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93ba7-2b33-4008-8376-4d55d3ae9ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:47.460250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-23a93ba7-2b33-4008-8376-4d55d3ae9ce1 None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:37:47.461579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-23a93ba7-2b33-4008-8376-4d55d3ae9ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:47.470171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 758/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Sep 22 14:37:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:37:47.478988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d61ac-622f-4e16-acbc-537cd0717db3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:37:47.492795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d61ac-622f-4e16-acbc-537cd0717db3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:37:47.497851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ec321-8281-44aa-b371-6cdc473d3523 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:37:47.498422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ec321-8281-44aa-b371-6cdc473d3523 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:47.498700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ec321-8281-44aa-b371-6cdc473d3523 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:47.498972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ec321-8281-44aa-b371-6cdc473d3523 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:47.507707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ec321-8281-44aa-b371-6cdc473d3523 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:37:47.509289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ec321-8281-44aa-b371-6cdc473d3523 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:37:47.520344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 763/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:37:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:37:53.713823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809126-17c9-44eb-b284-da57785cb43b None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:53.714449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809126-17c9-44eb-b284-da57785cb43b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:53.714449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809126-17c9-44eb-b284-da57785cb43b None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:53.715669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:37:53.722404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55dc14-2fbe-497d-b2fe-8f99022ba77a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:53.723048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55dc14-2fbe-497d-b2fe-8f99022ba77a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:53.723048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55dc14-2fbe-497d-b2fe-8f99022ba77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:53.743747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ad55dc14-2fbe-497d-b2fe-8f99022ba77a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:37:53.744965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ad55dc14-2fbe-497d-b2fe-8f99022ba77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:53.753080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:37:53.907580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809126-17c9-44eb-b284-da57785cb43b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:37:53.922401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809126-17c9-44eb-b284-da57785cb43b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:37:53.928170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a0fa8-6b54-4fb4-96b1-da691bd4efb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:37:53.928779 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0fa8-6b54-4fb4-96b1-da691bd4efb9 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:53.929055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0fa8-6b54-4fb4-96b1-da691bd4efb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:53.929328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0fa8-6b54-4fb4-96b1-da691bd4efb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:53.938156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a0fa8-6b54-4fb4-96b1-da691bd4efb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:37:53.939794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a0fa8-6b54-4fb4-96b1-da691bd4efb9 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:37:53.950670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 760/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:37:55.048998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a119853-0ac5-4d88-a68a-4fe6c38fbd78 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:55.049560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a119853-0ac5-4d88-a68a-4fe6c38fbd78 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:55.049560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a119853-0ac5-4d88-a68a-4fe6c38fbd78 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:55.051015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 22 14:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:37:55.058550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff7c2-c273-47fb-825b-9545bf612c71 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:55.059090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff7c2-c273-47fb-825b-9545bf612c71 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:55.059090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ff7c2-c273-47fb-825b-9545bf612c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:55.082986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fa8ff7c2-c273-47fb-825b-9545bf612c71 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:37:55.084214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fa8ff7c2-c273-47fb-825b-9545bf612c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:55.092206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 22 14:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:37:55.248885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a119853-0ac5-4d88-a68a-4fe6c38fbd78 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:37:55.263589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a119853-0ac5-4d88-a68a-4fe6c38fbd78 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:37:55.269107 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ee056-34cf-4ac6-a355-8c87ab73a8ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:37:55.270514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ee056-34cf-4ac6-a355-8c87ab73a8ce service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:55.270514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ee056-34cf-4ac6-a355-8c87ab73a8ce service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:55.270768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ee056-34cf-4ac6-a355-8c87ab73a8ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:55.279434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ee056-34cf-4ac6-a355-8c87ab73a8ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:37:55.281021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ee056-34cf-4ac6-a355-8c87ab73a8ce service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:37:55.292639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 766/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:37:59.439334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0486-00ae-4a75-bb4f-28e4c50fc0ee None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:59.439914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0486-00ae-4a75-bb4f-28e4c50fc0ee None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:59.439914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e0486-00ae-4a75-bb4f-28e4c50fc0ee None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:59.441192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:37:59.446857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9780-4061-4924-9bf6-204f689dc33e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:59.447381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9780-4061-4924-9bf6-204f689dc33e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:59.447488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9780-4061-4924-9bf6-204f689dc33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:59.477208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a06c9780-4061-4924-9bf6-204f689dc33e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:37:59.478481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a06c9780-4061-4924-9bf6-204f689dc33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:59.486505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:37:59.775933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e0486-00ae-4a75-bb4f-28e4c50fc0ee None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:37:59.777724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-be7e0486-00ae-4a75-bb4f-28e4c50fc0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:37:59.870591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e0486-00ae-4a75-bb4f-28e4c50fc0ee None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:37:59.874264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217ad92-67d0-449a-8f6d-911785d479bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:37:59.874903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217ad92-67d0-449a-8f6d-911785d479bc service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:37:59.875187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217ad92-67d0-449a-8f6d-911785d479bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:37:59.875465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217ad92-67d0-449a-8f6d-911785d479bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:37:59.886400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217ad92-67d0-449a-8f6d-911785d479bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:37:59.887853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217ad92-67d0-449a-8f6d-911785d479bc service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:37:59.899112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 763/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:38:02.106193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ed8e-b0f3-4628-a944-217a4fc4c5df None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:02.107083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ed8e-b0f3-4628-a944-217a4fc4c5df None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:02.107350 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1ed8e-b0f3-4628-a944-217a4fc4c5df None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:02.108812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:38:02.115082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4c6d1-8b39-42d4-9e62-c112ca88e861 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:02.115631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4c6d1-8b39-42d4-9e62-c112ca88e861 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:02.115631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4c6d1-8b39-42d4-9e62-c112ca88e861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:02.136145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fbe4c6d1-8b39-42d4-9e62-c112ca88e861 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:38:02.137374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fbe4c6d1-8b39-42d4-9e62-c112ca88e861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:38:02.146452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:38:02.442164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1ed8e-b0f3-4628-a944-217a4fc4c5df None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:38:02.447614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=75 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:38:02.453788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1ed8e-b0f3-4628-a944-217a4fc4c5df None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:38:02.457492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e69ebd-c22e-49c8-972f-f6d6d34c69d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:38:02.458847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69ebd-c22e-49c8-972f-f6d6d34c69d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:02.458847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69ebd-c22e-49c8-972f-f6d6d34c69d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:02.458847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e69ebd-c22e-49c8-972f-f6d6d34c69d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:02.468561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69ebd-c22e-49c8-972f-f6d6d34c69d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:38:02.470081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e69ebd-c22e-49c8-972f-f6d6d34c69d5 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:38:02.480447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 769/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:38:06.159579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708227b-fdcb-4c64-8831-0274895150a1 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:06.160208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708227b-fdcb-4c64-8831-0274895150a1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:06.160208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708227b-fdcb-4c64-8831-0274895150a1 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:06.161502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:38:06.167367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214103-6b83-406c-8fd0-090c96ec7a7d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:06.167832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214103-6b83-406c-8fd0-090c96ec7a7d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:06.167951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214103-6b83-406c-8fd0-090c96ec7a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:06.188313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e1214103-6b83-406c-8fd0-090c96ec7a7d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:38:06.189543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e1214103-6b83-406c-8fd0-090c96ec7a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:38:06.197756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:38:06.508658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708227b-fdcb-4c64-8831-0274895150a1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:38:06.510438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5708227b-fdcb-4c64-8831-0274895150a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:38:06.581528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:38:06.596660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708227b-fdcb-4c64-8831-0274895150a1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:38:06.600514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4c57d-ffff-40be-af90-6bd9bd26f1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:38:06.601812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4c57d-ffff-40be-af90-6bd9bd26f1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:06.602132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4c57d-ffff-40be-af90-6bd9bd26f1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:06.602412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4c57d-ffff-40be-af90-6bd9bd26f1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:06.612226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4c57d-ffff-40be-af90-6bd9bd26f1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:38:06.613679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4c57d-ffff-40be-af90-6bd9bd26f1c5 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:38:06.624121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 766/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:38:08.839166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835da645-6f62-4320-898e-88ea841a7c9d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:08.839794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835da645-6f62-4320-898e-88ea841a7c9d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:08.839794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835da645-6f62-4320-898e-88ea841a7c9d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:08.841060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 22 14:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:38:08.846664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a41a-ecb5-41c2-8a5a-899d7cb7cfea None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:08.847162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a41a-ecb5-41c2-8a5a-899d7cb7cfea None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:08.847304 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45a41a-ecb5-41c2-8a5a-899d7cb7cfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:08.868686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8c45a41a-ecb5-41c2-8a5a-899d7cb7cfea None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:38:08.869895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8c45a41a-ecb5-41c2-8a5a-899d7cb7cfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:38:08.877764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 22 14:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:38:09.178679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835da645-6f62-4320-898e-88ea841a7c9d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:38:09.180502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-835da645-6f62-4320-898e-88ea841a7c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:38:09.193393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835da645-6f62-4320-898e-88ea841a7c9d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:38:09.197024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb042e-21ed-4086-829c-5c67adaab8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:38:09.197653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb042e-21ed-4086-829c-5c67adaab8cc service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:38:09.197928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb042e-21ed-4086-829c-5c67adaab8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:38:09.198226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb042e-21ed-4086-829c-5c67adaab8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:38:09.211333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb042e-21ed-4086-829c-5c67adaab8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:38:09.212843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb042e-21ed-4086-829c-5c67adaab8cc service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:38:09.222486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 772/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:38:18.862292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=11 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:38:19.218373 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=14 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:41.051502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9413aa-2e9c-415a-8d5f-5bb0b5857319 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.052996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9413aa-2e9c-415a-8d5f-5bb0b5857319 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.053458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9413aa-2e9c-415a-8d5f-5bb0b5857319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.093076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ec9413aa-2e9c-415a-8d5f-5bb0b5857319 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.094795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ec9413aa-2e9c-415a-8d5f-5bb0b5857319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.106946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 768/1540] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.116335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e628a-4a60-4e98-b13c-b52065708486 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.116967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e628a-4a60-4e98-b13c-b52065708486 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.116967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e628a-4a60-4e98-b13c-b52065708486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.159057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-221e628a-4a60-4e98-b13c-b52065708486 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.161693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-221e628a-4a60-4e98-b13c-b52065708486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.177101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 773/1541] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.183145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9413aa-2e9c-415a-8d5f-5bb0b5857319 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.202007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9413aa-2e9c-415a-8d5f-5bb0b5857319 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.216849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047a643-c217-43a0-ad09-29165317667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.217771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a643-c217-43a0-ad09-29165317667c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.218247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a643-c217-43a0-ad09-29165317667c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.220896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a643-c217-43a0-ad09-29165317667c admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.221762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047a643-c217-43a0-ad09-29165317667c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:41.223289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047a643-c217-43a0-ad09-29165317667c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.227596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047a643-c217-43a0-ad09-29165317667c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.253624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 769/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:41.266863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e628a-4a60-4e98-b13c-b52065708486 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.281866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e628a-4a60-4e98-b13c-b52065708486 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.292589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51130539-2d7d-45ce-ba39-fdf6dbd5ff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.293459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130539-2d7d-45ce-ba39-fdf6dbd5ff02 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.293919 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130539-2d7d-45ce-ba39-fdf6dbd5ff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.294399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51130539-2d7d-45ce-ba39-fdf6dbd5ff02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.295341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130539-2d7d-45ce-ba39-fdf6dbd5ff02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.298310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51130539-2d7d-45ce-ba39-fdf6dbd5ff02 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.312911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77e1b3-f2b1-4fe8-8b4f-d4746377d836 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.313456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77e1b3-f2b1-4fe8-8b4f-d4746377d836 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.313903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77e1b3-f2b1-4fe8-8b4f-d4746377d836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.369656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7d77e1b3-f2b1-4fe8-8b4f-d4746377d836 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.376230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7d77e1b3-f2b1-4fe8-8b4f-d4746377d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.396888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 770/1543] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:39:41.396888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f992af-4cae-4d62-896d-bc43898c9c47 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.396888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f992af-4cae-4d62-896d-bc43898c9c47 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.396888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f992af-4cae-4d62-896d-bc43898c9c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.434591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-48f992af-4cae-4d62-896d-bc43898c9c47 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.435840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-48f992af-4cae-4d62-896d-bc43898c9c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.451663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 771/1544] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.452999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd72cf-ea85-4153-b58e-87273b4f5545 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.453320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd72cf-ea85-4153-b58e-87273b4f5545 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.453635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd72cf-ea85-4153-b58e-87273b4f5545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.477843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-afbd72cf-ea85-4153-b58e-87273b4f5545 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.479314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-afbd72cf-ea85-4153-b58e-87273b4f5545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.480455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 774/1545] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:41.481928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0811d6-2175-4621-9da5-f66c4b064f15 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.482484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0811d6-2175-4621-9da5-f66c4b064f15 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.482813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0811d6-2175-4621-9da5-f66c4b064f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.505523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1c0811d6-2175-4621-9da5-f66c4b064f15 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.507165 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1c0811d6-2175-4621-9da5-f66c4b064f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.570173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 772/1546] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.572597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2261-1243-439b-b869-2ba8e3eb5b3a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.572961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2261-1243-439b-b869-2ba8e3eb5b3a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.573324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f2261-1243-439b-b869-2ba8e3eb5b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.592338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 775/1547] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.594215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b1ef8-69a5-4964-b669-0fe3fe465d3c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.594506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b1ef8-69a5-4964-b669-0fe3fe465d3c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.594784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b1ef8-69a5-4964-b669-0fe3fe465d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.601849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b02f2261-1243-439b-b869-2ba8e3eb5b3a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.603380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b02f2261-1243-439b-b869-2ba8e3eb5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.613474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 773/1548] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.615485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3e96-9cdb-4f66-b52d-0fadd6c73120 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.615801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3e96-9cdb-4f66-b52d-0fadd6c73120 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.616090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c3e96-9cdb-4f66-b52d-0fadd6c73120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.625090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-654b1ef8-69a5-4964-b669-0fe3fe465d3c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.626379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-654b1ef8-69a5-4964-b669-0fe3fe465d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.635576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 776/1549] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.637028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be524fb3-b0f2-4c68-83be-852b7cf7ba71 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.637298 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be524fb3-b0f2-4c68-83be-852b7cf7ba71 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.637575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be524fb3-b0f2-4c68-83be-852b7cf7ba71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.643836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-324c3e96-9cdb-4f66-b52d-0fadd6c73120 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.645070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-324c3e96-9cdb-4f66-b52d-0fadd6c73120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.663282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 774/1550] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.663282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3e96-9cdb-4f66-b52d-0fadd6c73120 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.663590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-be524fb3-b0f2-4c68-83be-852b7cf7ba71 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.663590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-be524fb3-b0f2-4c68-83be-852b7cf7ba71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.667321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c3e96-9cdb-4f66-b52d-0fadd6c73120 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.669575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 777/1551] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.670976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003e19-d119-4009-801f-cc2ca5467c8e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.671266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003e19-d119-4009-801f-cc2ca5467c8e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.671542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac003e19-d119-4009-801f-cc2ca5467c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.673514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af336b36-dcba-4ac7-bffd-8ad88113f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.674174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af336b36-dcba-4ac7-bffd-8ad88113f262 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.674460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af336b36-dcba-4ac7-bffd-8ad88113f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.674732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af336b36-dcba-4ac7-bffd-8ad88113f262 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.675365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af336b36-dcba-4ac7-bffd-8ad88113f262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.677607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af336b36-dcba-4ac7-bffd-8ad88113f262 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.692017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ac003e19-d119-4009-801f-cc2ca5467c8e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.694663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ac003e19-d119-4009-801f-cc2ca5467c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.704194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 778/1552] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.706688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac003e19-d119-4009-801f-cc2ca5467c8e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.716754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac003e19-d119-4009-801f-cc2ca5467c8e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.721945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37966b72-c110-4d9c-bfa1-497615d1df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.722644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966b72-c110-4d9c-bfa1-497615d1df7e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.722948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966b72-c110-4d9c-bfa1-497615d1df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.723221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966b72-c110-4d9c-bfa1-497615d1df7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.723920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37966b72-c110-4d9c-bfa1-497615d1df7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:41.724288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37966b72-c110-4d9c-bfa1-497615d1df7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.725425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-37966b72-c110-4d9c-bfa1-497615d1df7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:39:41.725425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 22 14:39:41.725425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: Sep 22 14:39:41.726345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37966b72-c110-4d9c-bfa1-497615d1df7e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.741018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 779/1553] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:41.743295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716533-965b-42fa-aaf4-35eb83838443 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.743799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716533-965b-42fa-aaf4-35eb83838443 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.744239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac716533-965b-42fa-aaf4-35eb83838443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.766251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ac716533-965b-42fa-aaf4-35eb83838443 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.767448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ac716533-965b-42fa-aaf4-35eb83838443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.775647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 780/1554] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.776882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c82822-9cee-476a-946a-726e9166a635 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.777160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c82822-9cee-476a-946a-726e9166a635 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.777947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c82822-9cee-476a-946a-726e9166a635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.788773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 775/1555] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:41.790501 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98bed2-b85b-4a0d-a258-2eb9ab652750 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.790787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98bed2-b85b-4a0d-a258-2eb9ab652750 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.791059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98bed2-b85b-4a0d-a258-2eb9ab652750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.802314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-19c82822-9cee-476a-946a-726e9166a635 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.803533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-19c82822-9cee-476a-946a-726e9166a635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.811768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 781/1556] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.812933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3e98bed2-b85b-4a0d-a258-2eb9ab652750 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.813078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9036cf-e0f9-4d5d-8932-513af8994dcb None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.813332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9036cf-e0f9-4d5d-8932-513af8994dcb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.813610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9036cf-e0f9-4d5d-8932-513af8994dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.814152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3e98bed2-b85b-4a0d-a258-2eb9ab652750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.822938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 776/1557] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.823656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98bed2-b85b-4a0d-a258-2eb9ab652750 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.833220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98bed2-b85b-4a0d-a258-2eb9ab652750 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.840875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3e9036cf-e0f9-4d5d-8932-513af8994dcb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.840875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3e9036cf-e0f9-4d5d-8932-513af8994dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.841146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.841146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.841146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.841146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.841538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:41.841538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.841991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.844774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 782/1558] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.846879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9036cf-e0f9-4d5d-8932-513af8994dcb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.854592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 777/1559] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:41.855418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.859134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9036cf-e0f9-4d5d-8932-513af8994dcb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.865761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e5841-a5e0-46f9-91c7-31bdb60b4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.866007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bffea-3e2d-4c2b-a66f-b0458cfa2247 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.866423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5841-a5e0-46f9-91c7-31bdb60b4d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.866705 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5841-a5e0-46f9-91c7-31bdb60b4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.867273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5841-a5e0-46f9-91c7-31bdb60b4d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.867640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e5841-a5e0-46f9-91c7-31bdb60b4d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:41.867948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e5841-a5e0-46f9-91c7-31bdb60b4d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.869600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e5841-a5e0-46f9-91c7-31bdb60b4d60 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.870649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.871251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.871526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.871817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.872475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.873477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:39:41.873477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: warnings.warn(msg) Sep 22 14:39:41.873477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: Sep 22 14:39:41.874680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.881766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 783/1560] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:41.883048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfed71-2302-46aa-bbb1-d387be5b81d1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.883338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfed71-2302-46aa-bbb1-d387be5b81d1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.883615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfed71-2302-46aa-bbb1-d387be5b81d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.906146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-69cfed71-2302-46aa-bbb1-d387be5b81d1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:41.907353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-69cfed71-2302-46aa-bbb1-d387be5b81d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:41.916142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 784/1561] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:41.916920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfed71-2302-46aa-bbb1-d387be5b81d1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.926092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfed71-2302-46aa-bbb1-d387be5b81d1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.931448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cbe35-3376-4e5c-9432-643d660f5f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.932045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cbe35-3376-4e5c-9432-643d660f5f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.932327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cbe35-3376-4e5c-9432-643d660f5f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.932943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cbe35-3376-4e5c-9432-643d660f5f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.933704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cbe35-3376-4e5c-9432-643d660f5f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.935385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cbe35-3376-4e5c-9432-643d660f5f4e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.945653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 785/1562] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:41.946733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cbe35-3376-4e5c-9432-643d660f5f4e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.956379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cbe35-3376-4e5c-9432-643d660f5f4e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:41.961867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:41.962485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:41.962762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:41.963033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:41.963651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:41.963953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:41.965470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:41.977945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 786/1563] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:41.977945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.989204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 778/1564] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:41.990005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:41.990838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d060e4-51fb-4563-b9b4-04e61620cd1d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.019016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:42.052394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:42.053964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.054727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.055948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.055948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.055948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:42.056257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.057824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.058400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7ea7-f61c-489c-ae80-b4619db95885 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.063225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.063834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.064111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.064388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.065038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:42.065341 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.067049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.075027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 787/1565] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:42.075027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.079904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 779/1566] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:42.080664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.081286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3caf14-1c64-4424-901a-9285ad9edd2d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.086493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0dbd1-235f-4500-a94c-ccf518a502fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.087315 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0dbd1-235f-4500-a94c-ccf518a502fc admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.087849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0dbd1-235f-4500-a94c-ccf518a502fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.088129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0dbd1-235f-4500-a94c-ccf518a502fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.088765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0dbd1-235f-4500-a94c-ccf518a502fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.090695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0dbd1-235f-4500-a94c-ccf518a502fc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.091200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61326-01b6-49de-b3a3-63ccaeeaac7b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.096144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748aae5-0480-402b-b60c-69b6e0b2236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.096749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748aae5-0480-402b-b60c-69b6e0b2236d admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.097027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748aae5-0480-402b-b60c-69b6e0b2236d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.097295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748aae5-0480-402b-b60c-69b6e0b2236d admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.097922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748aae5-0480-402b-b60c-69b6e0b2236d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.101089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748aae5-0480-402b-b60c-69b6e0b2236d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.212345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 788/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:42 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:42.213184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0dbd1-235f-4500-a94c-ccf518a502fc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.246751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 780/1568] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:42 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:42.247598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748aae5-0480-402b-b60c-69b6e0b2236d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.277654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0dbd1-235f-4500-a94c-ccf518a502fc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.311759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748aae5-0480-402b-b60c-69b6e0b2236d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.316556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de093d-6787-48b9-ba30-a93b3aea0d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.317670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de093d-6787-48b9-ba30-a93b3aea0d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.318048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de093d-6787-48b9-ba30-a93b3aea0d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.318597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de093d-6787-48b9-ba30-a93b3aea0d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.318975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de093d-6787-48b9-ba30-a93b3aea0d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.320578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de093d-6787-48b9-ba30-a93b3aea0d1a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.331283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 781/1569] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:42.335860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de093d-6787-48b9-ba30-a93b3aea0d1a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.337750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.338413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.338694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.338969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.339624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:42.340111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.341690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.345794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de093d-6787-48b9-ba30-a93b3aea0d1a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.351042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb849de-6a35-48dd-8103-06b6ded16a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.351677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb849de-6a35-48dd-8103-06b6ded16a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.351980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb849de-6a35-48dd-8103-06b6ded16a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.352235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb849de-6a35-48dd-8103-06b6ded16a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.352896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb849de-6a35-48dd-8103-06b6ded16a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.354249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 789/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:42.354812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb849de-6a35-48dd-8103-06b6ded16a11 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.358926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.370263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a9566-2b40-4946-be7e-afd73011c79c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.375654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.376255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.376564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.376859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.377479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.378567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:39:42.378567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 22 14:39:42.378567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: Sep 22 14:39:42.385831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.485280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 782/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:42 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:42.486131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb849de-6a35-48dd-8103-06b6ded16a11 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.502313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 790/1572] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:42 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:42.506936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.516885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950ee6-ee31-40b9-86c7-fee9e27aa3f2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.545471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:42.552526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb849de-6a35-48dd-8103-06b6ded16a11 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.557636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aad34-220a-4842-87b1-addb155ed897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.557934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aad34-220a-4842-87b1-addb155ed897 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.558260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aad34-220a-4842-87b1-addb155ed897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.558532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aad34-220a-4842-87b1-addb155ed897 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.559164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aad34-220a-4842-87b1-addb155ed897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.561060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aad34-220a-4842-87b1-addb155ed897 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.597659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7699-faed-4262-b568-a83a79b97956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.597659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7699-faed-4262-b568-a83a79b97956 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.597659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7699-faed-4262-b568-a83a79b97956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.597659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7699-faed-4262-b568-a83a79b97956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.598347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e7699-faed-4262-b568-a83a79b97956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.598347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e7699-faed-4262-b568-a83a79b97956 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.686536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 783/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:42 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:42.687439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aad34-220a-4842-87b1-addb155ed897 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.719502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:42.753882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aad34-220a-4842-87b1-addb155ed897 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.761334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9e301-787d-457f-a145-82911492a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.762009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e301-787d-457f-a145-82911492a13e admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.762366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e301-787d-457f-a145-82911492a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.762664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e301-787d-457f-a145-82911492a13e admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.763353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9e301-787d-457f-a145-82911492a13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.765370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9e301-787d-457f-a145-82911492a13e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.789301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 791/1574] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:42 2022] POST /identity/v3/projects => generated 375 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:42.790357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7699-faed-4262-b568-a83a79b97956 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.851667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7699-faed-4262-b568-a83a79b97956 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.856253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b6f1-ed62-4b3b-81aa-9b7cf165d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.856854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b6f1-ed62-4b3b-81aa-9b7cf165d7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.857130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b6f1-ed62-4b3b-81aa-9b7cf165d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.857402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b6f1-ed62-4b3b-81aa-9b7cf165d7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.858050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b6f1-ed62-4b3b-81aa-9b7cf165d7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.859953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b6f1-ed62-4b3b-81aa-9b7cf165d7f2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:42.877119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 784/1575] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:42 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:42.877119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9e301-787d-457f-a145-82911492a13e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:42.885242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9e301-787d-457f-a145-82911492a13e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:42.890013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:42.890658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:42.890938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:42.891213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] PATH_INFO: `/v3/projects/36ad3c330e78459a9848bf063de7f685/users/7b62e44857f14410b29fcf12bbc75848/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:42.905940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ad3c330e78459a9848bf063de7f685, user_id=7b62e44857f14410b29fcf12bbc75848, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:42.907002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:39:42.907002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: warnings.warn(msg) Sep 22 14:39:42.907002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: Sep 22 14:39:42.908973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.016628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 792/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:42 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:43.017594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b6f1-ed62-4b3b-81aa-9b7cf165d7f2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.030362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b6f1-ed62-4b3b-81aa-9b7cf165d7f2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.039475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 785/1577] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:42 2022] PUT /identity/v3/projects/36ad3c330e78459a9848bf063de7f685/users/7b62e44857f14410b29fcf12bbc75848/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:43.040741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.105831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93c9fe-3237-4f0f-9069-9b758e9e625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.106387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c9fe-3237-4f0f-9069-9b758e9e625e admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.106675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c9fe-3237-4f0f-9069-9b758e9e625e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.106953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c9fe-3237-4f0f-9069-9b758e9e625e admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.107599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93c9fe-3237-4f0f-9069-9b758e9e625e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.109529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93c9fe-3237-4f0f-9069-9b758e9e625e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.119449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4166919-7f2f-4166-8c33-2a77f905cfcf admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.124483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6f9bb-1e78-4d72-9080-1974475213e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.124969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f9bb-1e78-4d72-9080-1974475213e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.125254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f9bb-1e78-4d72-9080-1974475213e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.125532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f9bb-1e78-4d72-9080-1974475213e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.126255 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6f9bb-1e78-4d72-9080-1974475213e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.128250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6f9bb-1e78-4d72-9080-1974475213e7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.230496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 793/1578] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:43 2022] POST /identity/v3/projects => generated 391 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:43.231357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93c9fe-3237-4f0f-9069-9b758e9e625e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.252154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 786/1579] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:43 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:43.253317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6f9bb-1e78-4d72-9080-1974475213e7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.262600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:43.263640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6f9bb-1e78-4d72-9080-1974475213e7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.316499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93c9fe-3237-4f0f-9069-9b758e9e625e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.324487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3241b-01a8-4e2c-8f30-ebd6f1e97371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.325434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3241b-01a8-4e2c-8f30-ebd6f1e97371 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.325768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3241b-01a8-4e2c-8f30-ebd6f1e97371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.326192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3241b-01a8-4e2c-8f30-ebd6f1e97371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.326963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3241b-01a8-4e2c-8f30-ebd6f1e97371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.328832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3241b-01a8-4e2c-8f30-ebd6f1e97371 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.337583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c31cc-b812-4589-8d45-9d002f52f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.338228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c31cc-b812-4589-8d45-9d002f52f439 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.338580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c31cc-b812-4589-8d45-9d002f52f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.338848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c31cc-b812-4589-8d45-9d002f52f439 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.339485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c31cc-b812-4589-8d45-9d002f52f439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.341472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c31cc-b812-4589-8d45-9d002f52f439 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.347521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 794/1580] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.347521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3241b-01a8-4e2c-8f30-ebd6f1e97371 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.354706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3241b-01a8-4e2c-8f30-ebd6f1e97371 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.359708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20378-15e2-4da8-96fa-6dc0d2f17300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.360251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20378-15e2-4da8-96fa-6dc0d2f17300 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.360530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20378-15e2-4da8-96fa-6dc0d2f17300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.360804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20378-15e2-4da8-96fa-6dc0d2f17300 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.361461 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20378-15e2-4da8-96fa-6dc0d2f17300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.363436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20378-15e2-4da8-96fa-6dc0d2f17300 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.422245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 787/1581] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:43 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:43.423306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c31cc-b812-4589-8d45-9d002f52f439 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.433398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c31cc-b812-4589-8d45-9d002f52f439 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.435308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 795/1582] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:43 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:43.436215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20378-15e2-4da8-96fa-6dc0d2f17300 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.438646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9e9a5-dfdd-45a6-b4e4-a811b26b35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.439367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e9a5-dfdd-45a6-b4e4-a811b26b35f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.439710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e9a5-dfdd-45a6-b4e4-a811b26b35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.439991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9e9a5-dfdd-45a6-b4e4-a811b26b35f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.440640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9e9a5-dfdd-45a6-b4e4-a811b26b35f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.442283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9e9a5-dfdd-45a6-b4e4-a811b26b35f7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.446802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20378-15e2-4da8-96fa-6dc0d2f17300 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.449135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:43.453623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930779-92b8-4057-a97d-7449a9415a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.454435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930779-92b8-4057-a97d-7449a9415a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.454907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930779-92b8-4057-a97d-7449a9415a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.455308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb930779-92b8-4057-a97d-7449a9415a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.456256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb930779-92b8-4057-a97d-7449a9415a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.456457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 788/1583] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.457650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132624c0-00dd-4326-ba6b-f6921f8eb73f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.458786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132624c0-00dd-4326-ba6b-f6921f8eb73f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.459171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132624c0-00dd-4326-ba6b-f6921f8eb73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.459634 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb930779-92b8-4057-a97d-7449a9415a17 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.478085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 796/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.478085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930779-92b8-4057-a97d-7449a9415a17 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.488751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb930779-92b8-4057-a97d-7449a9415a17 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.492426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-132624c0-00dd-4326-ba6b-f6921f8eb73f None None] MFA Rules not processed for user `7b62e44857f14410b29fcf12bbc75848`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:43.496553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822f26-fb1d-4f89-88e3-a2718bf2b026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.496702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-132624c0-00dd-4326-ba6b-f6921f8eb73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:43.496791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822f26-fb1d-4f89-88e3-a2718bf2b026 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.496791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822f26-fb1d-4f89-88e3-a2718bf2b026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.496791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3822f26-fb1d-4f89-88e3-a2718bf2b026 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.496791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3822f26-fb1d-4f89-88e3-a2718bf2b026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.497386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3822f26-fb1d-4f89-88e3-a2718bf2b026 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.559170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 789/1585] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:43.560023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132624c0-00dd-4326-ba6b-f6921f8eb73f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.570971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132624c0-00dd-4326-ba6b-f6921f8eb73f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.578312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0243b-d208-45f4-a89f-a784f3fc53c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.578918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0243b-d208-45f4-a89f-a784f3fc53c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.579206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0243b-d208-45f4-a89f-a784f3fc53c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.579477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0243b-d208-45f4-a89f-a784f3fc53c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.580123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0243b-d208-45f4-a89f-a784f3fc53c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.581794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0243b-d208-45f4-a89f-a784f3fc53c2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.592770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 790/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.593658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0243b-d208-45f4-a89f-a784f3fc53c2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.604226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0243b-d208-45f4-a89f-a784f3fc53c2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.608912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db501d-03b8-4fc0-9703-81a076147540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.614407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db501d-03b8-4fc0-9703-81a076147540 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.614407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db501d-03b8-4fc0-9703-81a076147540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.614407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db501d-03b8-4fc0-9703-81a076147540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.614407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db501d-03b8-4fc0-9703-81a076147540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.614982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 797/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:43 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:43.614982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822f26-fb1d-4f89-88e3-a2718bf2b026 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.615263 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db501d-03b8-4fc0-9703-81a076147540 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.622620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3822f26-fb1d-4f89-88e3-a2718bf2b026 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.624884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 791/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.625838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db501d-03b8-4fc0-9703-81a076147540 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.627429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cfe80-3996-41e2-8696-fe51df6c4c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.628653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfe80-3996-41e2-8696-fe51df6c4c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.628940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfe80-3996-41e2-8696-fe51df6c4c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.629214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cfe80-3996-41e2-8696-fe51df6c4c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.630388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cfe80-3996-41e2-8696-fe51df6c4c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.632800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cfe80-3996-41e2-8696-fe51df6c4c36 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.637706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db501d-03b8-4fc0-9703-81a076147540 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.642342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931e899-e174-435b-9e5d-fc0e7f00d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.642936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931e899-e174-435b-9e5d-fc0e7f00d540 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.643213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931e899-e174-435b-9e5d-fc0e7f00d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.643488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931e899-e174-435b-9e5d-fc0e7f00d540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.643630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 798/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.644191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931e899-e174-435b-9e5d-fc0e7f00d540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.644363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cfe80-3996-41e2-8696-fe51df6c4c36 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.646360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931e899-e174-435b-9e5d-fc0e7f00d540 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.655172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cfe80-3996-41e2-8696-fe51df6c4c36 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.657734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 792/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.658668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931e899-e174-435b-9e5d-fc0e7f00d540 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.663651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e452-d1c1-4de1-8b62-934f9eeb0f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.664271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e452-d1c1-4de1-8b62-934f9eeb0f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.664551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e452-d1c1-4de1-8b62-934f9eeb0f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.665420 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e452-d1c1-4de1-8b62-934f9eeb0f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.665543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e452-d1c1-4de1-8b62-934f9eeb0f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.667092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e452-d1c1-4de1-8b62-934f9eeb0f05 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.671675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931e899-e174-435b-9e5d-fc0e7f00d540 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.673667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683d0a1-663c-48cb-a4fb-3a2784b46be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.674323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d0a1-663c-48cb-a4fb-3a2784b46be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.674615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d0a1-663c-48cb-a4fb-3a2784b46be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.674866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d0a1-663c-48cb-a4fb-3a2784b46be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.675499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683d0a1-663c-48cb-a4fb-3a2784b46be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.677097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683d0a1-663c-48cb-a4fb-3a2784b46be8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.678777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 799/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.679564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e452-d1c1-4de1-8b62-934f9eeb0f05 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.688254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 793/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.689430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683d0a1-663c-48cb-a4fb-3a2784b46be8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.690430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e452-d1c1-4de1-8b62-934f9eeb0f05 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.701475 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9708dd8-71dd-4af4-b7df-7620fd922416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.702145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9708dd8-71dd-4af4-b7df-7620fd922416 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.709323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9708dd8-71dd-4af4-b7df-7620fd922416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.709323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9708dd8-71dd-4af4-b7df-7620fd922416 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.709323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9708dd8-71dd-4af4-b7df-7620fd922416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.709323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9708dd8-71dd-4af4-b7df-7620fd922416 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.712561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683d0a1-663c-48cb-a4fb-3a2784b46be8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.717905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87f2ed-402c-4c48-8914-c19924905afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.718632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87f2ed-402c-4c48-8914-c19924905afb admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.719046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87f2ed-402c-4c48-8914-c19924905afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.719423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87f2ed-402c-4c48-8914-c19924905afb admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.720411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87f2ed-402c-4c48-8914-c19924905afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.722984 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87f2ed-402c-4c48-8914-c19924905afb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.742031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 794/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.742031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87f2ed-402c-4c48-8914-c19924905afb admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.750850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87f2ed-402c-4c48-8914-c19924905afb admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.756173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6df67-c6a9-4010-8954-38bd7a56200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.756781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6df67-c6a9-4010-8954-38bd7a56200b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.757236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6df67-c6a9-4010-8954-38bd7a56200b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.757624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6df67-c6a9-4010-8954-38bd7a56200b admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.758319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6df67-c6a9-4010-8954-38bd7a56200b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.759922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6df67-c6a9-4010-8954-38bd7a56200b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.771408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 795/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.772200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6df67-c6a9-4010-8954-38bd7a56200b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.787357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6df67-c6a9-4010-8954-38bd7a56200b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.794709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ebd46-b714-4917-88cb-cc137e62a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.795439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ebd46-b714-4917-88cb-cc137e62a630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.795722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ebd46-b714-4917-88cb-cc137e62a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.796028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ebd46-b714-4917-88cb-cc137e62a630 admin admin] PATH_INFO: `/v3/projects/1393fa02f09e4198aee55d19d4165c05/users/e31c29dd5cbb4ede8989904bfe4416ae/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.811552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ebd46-b714-4917-88cb-cc137e62a630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1393fa02f09e4198aee55d19d4165c05, user_id=e31c29dd5cbb4ede8989904bfe4416ae, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.814225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ebd46-b714-4917-88cb-cc137e62a630 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.824914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 800/1595] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:43 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:43.825893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9708dd8-71dd-4af4-b7df-7620fd922416 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.889260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9708dd8-71dd-4af4-b7df-7620fd922416 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.893906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ae48-22d3-4a06-9d46-f9a9e3889b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.894583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ae48-22d3-4a06-9d46-f9a9e3889b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.894897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ae48-22d3-4a06-9d46-f9a9e3889b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.895170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232ae48-22d3-4a06-9d46-f9a9e3889b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.896438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232ae48-22d3-4a06-9d46-f9a9e3889b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.898049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232ae48-22d3-4a06-9d46-f9a9e3889b79 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.903739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 796/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:43 2022] PUT /identity/v3/projects/1393fa02f09e4198aee55d19d4165c05/users/e31c29dd5cbb4ede8989904bfe4416ae/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:43.904688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ebd46-b714-4917-88cb-cc137e62a630 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.910220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 801/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.911080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ae48-22d3-4a06-9d46-f9a9e3889b79 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:43.921195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232ae48-22d3-4a06-9d46-f9a9e3889b79 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.947993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:43.972779 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ebd46-b714-4917-88cb-cc137e62a630 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:43.977859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d9e78-e783-4c24-bafb-eb36d7e94999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.978505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d9e78-e783-4c24-bafb-eb36d7e94999 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.978787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d9e78-e783-4c24-bafb-eb36d7e94999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.979189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d9e78-e783-4c24-bafb-eb36d7e94999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.979870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d9e78-e783-4c24-bafb-eb36d7e94999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:43.981571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d9e78-e783-4c24-bafb-eb36d7e94999 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:43.982949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:43.985314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99777b3e-534f-4607-91a1-b107f3cc61b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:43.985994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99777b3e-534f-4607-91a1-b107f3cc61b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:43.986381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99777b3e-534f-4607-91a1-b107f3cc61b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:43.986598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99777b3e-534f-4607-91a1-b107f3cc61b3 admin admin] PATH_INFO: `/v3/projects/69fdf651bd394978b2415510a76ab61e/users/5092f81bef514c83b75a5315952f5555/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:43.992672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 797/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:43.993281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d9e78-e783-4c24-bafb-eb36d7e94999 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.002525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99777b3e-534f-4607-91a1-b107f3cc61b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69fdf651bd394978b2415510a76ab61e, user_id=5092f81bef514c83b75a5315952f5555, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.003069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d9e78-e783-4c24-bafb-eb36d7e94999 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.005897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99777b3e-534f-4607-91a1-b107f3cc61b3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.008299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a530-9dae-47b6-87eb-f97f69823f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.008959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a530-9dae-47b6-87eb-f97f69823f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.009240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a530-9dae-47b6-87eb-f97f69823f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.009674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a530-9dae-47b6-87eb-f97f69823f0d admin admin] PATH_INFO: `/v3/projects/c9347312964c429298703188833119ea/users/23201bf82ef340329668c950d3be2f5f/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.025443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a530-9dae-47b6-87eb-f97f69823f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9347312964c429298703188833119ea, user_id=23201bf82ef340329668c950d3be2f5f, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.028153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a530-9dae-47b6-87eb-f97f69823f0d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.137035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 802/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:43 2022] PUT /identity/v3/projects/69fdf651bd394978b2415510a76ab61e/users/5092f81bef514c83b75a5315952f5555/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:44.138018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99777b3e-534f-4607-91a1-b107f3cc61b3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.163577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 798/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:43 2022] PUT /identity/v3/projects/c9347312964c429298703188833119ea/users/23201bf82ef340329668c950d3be2f5f/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:44.164335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a530-9dae-47b6-87eb-f97f69823f0d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.205915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99777b3e-534f-4607-91a1-b107f3cc61b3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.228664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a530-9dae-47b6-87eb-f97f69823f0d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.234525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84cf1-c935-447e-8016-e93eb6391b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.235138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84cf1-c935-447e-8016-e93eb6391b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.235416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84cf1-c935-447e-8016-e93eb6391b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.235688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce84cf1-c935-447e-8016-e93eb6391b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.236336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce84cf1-c935-447e-8016-e93eb6391b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.237989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce84cf1-c935-447e-8016-e93eb6391b3b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.248813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 799/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:44.249768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84cf1-c935-447e-8016-e93eb6391b3b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.260298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce84cf1-c935-447e-8016-e93eb6391b3b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.265013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123eef6-76a8-41ae-bda4-7810ac47a7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.265605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123eef6-76a8-41ae-bda4-7810ac47a7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.265886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123eef6-76a8-41ae-bda4-7810ac47a7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.266197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123eef6-76a8-41ae-bda4-7810ac47a7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.266820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123eef6-76a8-41ae-bda4-7810ac47a7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.268721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123eef6-76a8-41ae-bda4-7810ac47a7ba admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.269527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d79aa2-4181-4c18-944a-f4b933e8829a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.270229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d79aa2-4181-4c18-944a-f4b933e8829a admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.270512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d79aa2-4181-4c18-944a-f4b933e8829a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.270788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d79aa2-4181-4c18-944a-f4b933e8829a admin admin] PATH_INFO: `/v3/projects/ef192e7d697a46769806184345920ce3/users/ddc9556e5f7347948b6f872f1f854665/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.285697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d79aa2-4181-4c18-944a-f4b933e8829a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef192e7d697a46769806184345920ce3, user_id=ddc9556e5f7347948b6f872f1f854665, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.288490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d79aa2-4181-4c18-944a-f4b933e8829a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.372155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 800/1602] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:44 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:44.373636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737fe97-dcbb-43ef-ab52-32a1eb633682 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.373922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737fe97-dcbb-43ef-ab52-32a1eb633682 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.374223 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737fe97-dcbb-43ef-ab52-32a1eb633682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.383616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 803/1603] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:44 2022] PUT /identity/v3/projects/ef192e7d697a46769806184345920ce3/users/ddc9556e5f7347948b6f872f1f854665/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:44.386989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d79aa2-4181-4c18-944a-f4b933e8829a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.399988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f737fe97-dcbb-43ef-ab52-32a1eb633682 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:44.401219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f737fe97-dcbb-43ef-ab52-32a1eb633682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:44.437213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:44.464062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d79aa2-4181-4c18-944a-f4b933e8829a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.469371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebd8f5-965d-4b20-8bd5-638e8fa74738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.472885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebd8f5-965d-4b20-8bd5-638e8fa74738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.472885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebd8f5-965d-4b20-8bd5-638e8fa74738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.472885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebd8f5-965d-4b20-8bd5-638e8fa74738 admin admin] PATH_INFO: `/v3/projects/8db292e37b21403f9338784373e366cd/users/df62a159c08f48648c1eede93f79f282/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.473183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 801/1604] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:44.477815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737fe97-dcbb-43ef-ab52-32a1eb633682 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.491151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebd8f5-965d-4b20-8bd5-638e8fa74738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db292e37b21403f9338784373e366cd, user_id=df62a159c08f48648c1eede93f79f282, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.492359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737fe97-dcbb-43ef-ab52-32a1eb633682 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.493866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebd8f5-965d-4b20-8bd5-638e8fa74738 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.497487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2ae63-9d16-43c4-965a-8991fd952b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.498226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2ae63-9d16-43c4-965a-8991fd952b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.498496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2ae63-9d16-43c4-965a-8991fd952b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.498779 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2ae63-9d16-43c4-965a-8991fd952b49 admin admin] PATH_INFO: `/v3/projects/2eca605d3ff848caaa205b362a26f643/users/f7cc2925a9e34e34a8bf27ce8e213cb4/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.517419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2ae63-9d16-43c4-965a-8991fd952b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eca605d3ff848caaa205b362a26f643, user_id=f7cc2925a9e34e34a8bf27ce8e213cb4, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.520582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2ae63-9d16-43c4-965a-8991fd952b49 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.547621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 804/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:44 2022] PUT /identity/v3/projects/8db292e37b21403f9338784373e366cd/users/df62a159c08f48648c1eede93f79f282/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:44.548887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8941-3614-40d2-a6b0-5e92bfe653cc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.549180 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8941-3614-40d2-a6b0-5e92bfe653cc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.549485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8941-3614-40d2-a6b0-5e92bfe653cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.580482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a07b8941-3614-40d2-a6b0-5e92bfe653cc None None] MFA Rules not processed for user `5092f81bef514c83b75a5315952f5555`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:44.581717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a07b8941-3614-40d2-a6b0-5e92bfe653cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:44.583114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 802/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:44 2022] PUT /identity/v3/projects/2eca605d3ff848caaa205b362a26f643/users/f7cc2925a9e34e34a8bf27ce8e213cb4/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:44.584755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847336f-5b59-4a3e-8c90-1c728c360ca8 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.585023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847336f-5b59-4a3e-8c90-1c728c360ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.593412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847336f-5b59-4a3e-8c90-1c728c360ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.617585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5847336f-5b59-4a3e-8c90-1c728c360ca8 None None] MFA Rules not processed for user `23201bf82ef340329668c950d3be2f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:44.618875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5847336f-5b59-4a3e-8c90-1c728c360ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:44.632828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:44.658049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 805/1607] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:44.658970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8941-3614-40d2-a6b0-5e92bfe653cc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.695962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 803/1608] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:44.698498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847336f-5b59-4a3e-8c90-1c728c360ca8 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.733766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8941-3614-40d2-a6b0-5e92bfe653cc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.738706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d24f4c-ff5b-4e00-b0e0-e0803767f4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.740242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24f4c-ff5b-4e00-b0e0-e0803767f4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.740529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24f4c-ff5b-4e00-b0e0-e0803767f4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.740812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d24f4c-ff5b-4e00-b0e0-e0803767f4e5 admin admin] PATH_INFO: `/v3/projects/0f63b2df0996478d9c4f8b5c25baa5cb/users/e4c7cd885cc24bf2934e4e9cecb50ee8/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.757205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24f4c-ff5b-4e00-b0e0-e0803767f4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f63b2df0996478d9c4f8b5c25baa5cb, user_id=e4c7cd885cc24bf2934e4e9cecb50ee8, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.759970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d24f4c-ff5b-4e00-b0e0-e0803767f4e5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.764956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847336f-5b59-4a3e-8c90-1c728c360ca8 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.769638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad9bd8-4ec4-4ab8-8c31-4311127022be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.770897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9bd8-4ec4-4ab8-8c31-4311127022be admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.771345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9bd8-4ec4-4ab8-8c31-4311127022be admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.771770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9bd8-4ec4-4ab8-8c31-4311127022be admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.772281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad9bd8-4ec4-4ab8-8c31-4311127022be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:44.773885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad9bd8-4ec4-4ab8-8c31-4311127022be admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:44.784213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 804/1609] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:44.791512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63af6f-c142-4c28-a077-dbe8388670ea None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.791512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63af6f-c142-4c28-a077-dbe8388670ea None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.791512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63af6f-c142-4c28-a077-dbe8388670ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.805384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fa63af6f-c142-4c28-a077-dbe8388670ea None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:44.806641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fa63af6f-c142-4c28-a077-dbe8388670ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:44.814814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 805/1610] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:44.815698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63af6f-c142-4c28-a077-dbe8388670ea None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:44.817683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fa63af6f-c142-4c28-a077-dbe8388670ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:44.851828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 806/1611] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:44 2022] PUT /identity/v3/projects/0f63b2df0996478d9c4f8b5c25baa5cb/users/e4c7cd885cc24bf2934e4e9cecb50ee8/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:44.856895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246d6b-5f02-40ab-a500-79e127491407 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.857179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246d6b-5f02-40ab-a500-79e127491407 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.857457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58246d6b-5f02-40ab-a500-79e127491407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.880332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63af6f-c142-4c28-a077-dbe8388670ea None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:44.886985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-58246d6b-5f02-40ab-a500-79e127491407 None None] MFA Rules not processed for user `df62a159c08f48648c1eede93f79f282`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:44.888201 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-58246d6b-5f02-40ab-a500-79e127491407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:44.909260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:44.932781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60423b7a-eb92-46d3-bf95-bb95a37fa8f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:44.933400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60423b7a-eb92-46d3-bf95-bb95a37fa8f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.933684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60423b7a-eb92-46d3-bf95-bb95a37fa8f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.933954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60423b7a-eb92-46d3-bf95-bb95a37fa8f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.947837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:44.958805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 807/1612] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:44.960381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f0deb-3281-481f-8fba-af06932ea917 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:44.960381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f0deb-3281-481f-8fba-af06932ea917 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:44.960584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f0deb-3281-481f-8fba-af06932ea917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:44.991382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e77f0deb-3281-481f-8fba-af06932ea917 None None] MFA Rules not processed for user `f7cc2925a9e34e34a8bf27ce8e213cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:44.992718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e77f0deb-3281-481f-8fba-af06932ea917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:44.998899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60423b7a-eb92-46d3-bf95-bb95a37fa8f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.000335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60423b7a-eb92-46d3-bf95-bb95a37fa8f9 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.010803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 806/1613] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:45.011923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5fb3-1e62-489b-9363-51f9c66a9828 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.012210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5fb3-1e62-489b-9363-51f9c66a9828 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.012486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5fb3-1e62-489b-9363-51f9c66a9828 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.013774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 807/1614] 10.222.0.16 () {54 vars in 961 bytes} [Thu Sep 22 14:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:39:45.014504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5fb3-1e62-489b-9363-51f9c66a9828 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.029298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5fb3-1e62-489b-9363-51f9c66a9828 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.035251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013df9bd-7d8d-4afe-8a68-532eec9802c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.036335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013df9bd-7d8d-4afe-8a68-532eec9802c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.036335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013df9bd-7d8d-4afe-8a68-532eec9802c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.036595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013df9bd-7d8d-4afe-8a68-532eec9802c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.037126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013df9bd-7d8d-4afe-8a68-532eec9802c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.039084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013df9bd-7d8d-4afe-8a68-532eec9802c4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.078656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 808/1615] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:45.079731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f0deb-3281-481f-8fba-af06932ea917 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.091472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f0deb-3281-481f-8fba-af06932ea917 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.097029 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02251a-6501-4b8d-8a01-3b1d9223b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.097767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02251a-6501-4b8d-8a01-3b1d9223b09c admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.098538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02251a-6501-4b8d-8a01-3b1d9223b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.098822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02251a-6501-4b8d-8a01-3b1d9223b09c admin admin] PATH_INFO: `/v3/projects/24dd00544d40435f9e9ec724b710cf3c/users/149fd61424c947988b9172c20f38192d/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.117923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02251a-6501-4b8d-8a01-3b1d9223b09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dd00544d40435f9e9ec724b710cf3c, user_id=149fd61424c947988b9172c20f38192d, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.121317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02251a-6501-4b8d-8a01-3b1d9223b09c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.132838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 808/1616] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:45 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:45.132838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013df9bd-7d8d-4afe-8a68-532eec9802c4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.193429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013df9bd-7d8d-4afe-8a68-532eec9802c4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.197407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a76db-f28f-4b7d-a5e0-444e7fb1bd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.198127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a76db-f28f-4b7d-a5e0-444e7fb1bd80 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.198331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a76db-f28f-4b7d-a5e0-444e7fb1bd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.198604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a76db-f28f-4b7d-a5e0-444e7fb1bd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.216117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 809/1617] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:45 2022] PUT /identity/v3/projects/24dd00544d40435f9e9ec724b710cf3c/users/149fd61424c947988b9172c20f38192d/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:45.217549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fdfc-420f-4735-b41a-8c34ae50bff9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.222726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fdfc-420f-4735-b41a-8c34ae50bff9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.222726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63fdfc-420f-4735-b41a-8c34ae50bff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.239820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1a63fdfc-420f-4735-b41a-8c34ae50bff9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:45.241545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1a63fdfc-420f-4735-b41a-8c34ae50bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:45.267346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a76db-f28f-4b7d-a5e0-444e7fb1bd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.268905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a76db-f28f-4b7d-a5e0-444e7fb1bd80 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.279858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 809/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:45.280649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a76db-f28f-4b7d-a5e0-444e7fb1bd80 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.291678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a76db-f28f-4b7d-a5e0-444e7fb1bd80 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.312435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 810/1619] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:45.314163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ad39b-2ffb-49a2-b9ef-e13e7132b5a8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.314447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ad39b-2ffb-49a2-b9ef-e13e7132b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.314767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ad39b-2ffb-49a2-b9ef-e13e7132b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.344804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:45.367919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9ba04-b93b-4cb7-a32e-1141ed9c96c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.368639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9ba04-b93b-4cb7-a32e-1141ed9c96c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.369037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9ba04-b93b-4cb7-a32e-1141ed9c96c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.369369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9ba04-b93b-4cb7-a32e-1141ed9c96c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.370236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9ba04-b93b-4cb7-a32e-1141ed9c96c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.372264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9ba04-b93b-4cb7-a32e-1141ed9c96c8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.391006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-dd4ad39b-2ffb-49a2-b9ef-e13e7132b5a8 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:45.393110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dd4ad39b-2ffb-49a2-b9ef-e13e7132b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:45.413488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:45.477207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 811/1620] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Sep 22 14:39:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:45.478632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29620-a8cc-4fde-a53e-233688d9fb75 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.478893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29620-a8cc-4fde-a53e-233688d9fb75 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.479169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29620-a8cc-4fde-a53e-233688d9fb75 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.480559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 812/1621] 10.222.0.16 () {54 vars in 961 bytes} [Thu Sep 22 14:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:39:45.485648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f29620-a8cc-4fde-a53e-233688d9fb75 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.492482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 810/1622] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:45 2022] POST /identity/v3/projects => generated 363 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:45.493330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9ba04-b93b-4cb7-a32e-1141ed9c96c8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.500600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f29620-a8cc-4fde-a53e-233688d9fb75 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.568858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d93e0-062f-4917-bf5c-8701f9cb2664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.569492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d93e0-062f-4917-bf5c-8701f9cb2664 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.569776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d93e0-062f-4917-bf5c-8701f9cb2664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.570160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d93e0-062f-4917-bf5c-8701f9cb2664 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.570821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d93e0-062f-4917-bf5c-8701f9cb2664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.571288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9ba04-b93b-4cb7-a32e-1141ed9c96c8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.573060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d93e0-062f-4917-bf5c-8701f9cb2664 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.577456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5b586-fc24-4256-92fa-4bef0688f0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.578228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5b586-fc24-4256-92fa-4bef0688f0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.578632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5b586-fc24-4256-92fa-4bef0688f0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.578746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5b586-fc24-4256-92fa-4bef0688f0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.579465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5b586-fc24-4256-92fa-4bef0688f0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.581085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5b586-fc24-4256-92fa-4bef0688f0ff admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.593543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 811/1623] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:45.594445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5b586-fc24-4256-92fa-4bef0688f0ff admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.655989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5b586-fc24-4256-92fa-4bef0688f0ff admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.659801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963f5d3-35b0-4141-b93b-878a4b85faa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.660422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f5d3-35b0-4141-b93b-878a4b85faa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.660703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f5d3-35b0-4141-b93b-878a4b85faa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.661935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f5d3-35b0-4141-b93b-878a4b85faa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.672080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f5d3-35b0-4141-b93b-878a4b85faa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.673514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f5d3-35b0-4141-b93b-878a4b85faa0 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.683737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 812/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:45.685011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f201-38a5-4793-b0ab-2f3f7062db08 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.685293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f201-38a5-4793-b0ab-2f3f7062db08 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.685566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247f201-38a5-4793-b0ab-2f3f7062db08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.706368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1247f201-38a5-4793-b0ab-2f3f7062db08 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:45.709144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1247f201-38a5-4793-b0ab-2f3f7062db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:45.746061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 813/1625] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:45 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:45.747191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d93e0-062f-4917-bf5c-8701f9cb2664 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.772274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:45.791653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 813/1626] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Sep 22 14:39:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:45.792893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f201-38a5-4793-b0ab-2f3f7062db08 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.804391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247f201-38a5-4793-b0ab-2f3f7062db08 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.810413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4c99-f95e-4643-afa5-12bef1e27b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.811038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4c99-f95e-4643-afa5-12bef1e27b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.811323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4c99-f95e-4643-afa5-12bef1e27b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.811600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab4c99-f95e-4643-afa5-12bef1e27b89 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.812234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4c99-f95e-4643-afa5-12bef1e27b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.814282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab4c99-f95e-4643-afa5-12bef1e27b89 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.838095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d93e0-062f-4917-bf5c-8701f9cb2664 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.844780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98413a2-58da-4a43-a144-18810dddf497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.845570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98413a2-58da-4a43-a144-18810dddf497 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.845947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98413a2-58da-4a43-a144-18810dddf497 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.846856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98413a2-58da-4a43-a144-18810dddf497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.885326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:45.922231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98413a2-58da-4a43-a144-18810dddf497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.924064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98413a2-58da-4a43-a144-18810dddf497 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.935093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 814/1627] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:45.935849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98413a2-58da-4a43-a144-18810dddf497 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.946646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98413a2-58da-4a43-a144-18810dddf497 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:45.951562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb05fc7-de0a-4ff7-b75d-a2b46da26d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:45.952219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05fc7-de0a-4ff7-b75d-a2b46da26d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:45.952498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05fc7-de0a-4ff7-b75d-a2b46da26d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:45.952774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05fc7-de0a-4ff7-b75d-a2b46da26d61 admin admin] PATH_INFO: `/v3/projects/24dd00544d40435f9e9ec724b710cf3c/users/149fd61424c947988b9172c20f38192d/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:45.954778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb05fc7-de0a-4ff7-b75d-a2b46da26d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dd00544d40435f9e9ec724b710cf3c, user_id=149fd61424c947988b9172c20f38192d, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:45.957411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb05fc7-de0a-4ff7-b75d-a2b46da26d61 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:45.973687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 815/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:45 2022] PUT /identity/v3/projects/24dd00544d40435f9e9ec724b710cf3c/users/149fd61424c947988b9172c20f38192d/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:45.973687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb05fc7-de0a-4ff7-b75d-a2b46da26d61 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:45.979948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 814/1629] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:45 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:45.981369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4c99-f95e-4643-afa5-12bef1e27b89 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:46.000910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab4c99-f95e-4643-afa5-12bef1e27b89 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.103687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb05fc7-de0a-4ff7-b75d-a2b46da26d61 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.107950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6d1f-88de-4b27-ab14-9e247d034112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.108840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6d1f-88de-4b27-ab14-9e247d034112 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.109197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6d1f-88de-4b27-ab14-9e247d034112 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.110004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6d1f-88de-4b27-ab14-9e247d034112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.115534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bf80e-9209-453c-b5ec-9d8f2e8aebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.117670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf80e-9209-453c-b5ec-9d8f2e8aebca admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.117670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf80e-9209-453c-b5ec-9d8f2e8aebca admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.117670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf80e-9209-453c-b5ec-9d8f2e8aebca admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.118263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf80e-9209-453c-b5ec-9d8f2e8aebca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:46.121344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf80e-9209-453c-b5ec-9d8f2e8aebca admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:46.151224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 816/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:46.153802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564b589-89c6-4139-b1cb-63181aeab835 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.154152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564b589-89c6-4139-b1cb-63181aeab835 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.154438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564b589-89c6-4139-b1cb-63181aeab835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.223250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6d1f-88de-4b27-ab14-9e247d034112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:46.224216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6564b589-89c6-4139-b1cb-63181aeab835 None None] MFA Rules not processed for user `149fd61424c947988b9172c20f38192d`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:46.225956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6564b589-89c6-4139-b1cb-63181aeab835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:46.231518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6d1f-88de-4b27-ab14-9e247d034112 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:46.250039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 815/1631] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:46.250954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6d1f-88de-4b27-ab14-9e247d034112 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:46.265806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6d1f-88de-4b27-ab14-9e247d034112 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.274265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a843f-26d9-4a5c-a169-8c4785b76e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.275367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a843f-26d9-4a5c-a169-8c4785b76e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.275887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a843f-26d9-4a5c-a169-8c4785b76e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.276275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a843f-26d9-4a5c-a169-8c4785b76e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.277047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a843f-26d9-4a5c-a169-8c4785b76e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:46.278951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a843f-26d9-4a5c-a169-8c4785b76e75 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:46.294155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 816/1632] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:46.295443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a843f-26d9-4a5c-a169-8c4785b76e75 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:46.318372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a843f-26d9-4a5c-a169-8c4785b76e75 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.321265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d639-03bb-45e6-9430-1b37a9b91733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.322346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d639-03bb-45e6-9430-1b37a9b91733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.322749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d639-03bb-45e6-9430-1b37a9b91733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.323225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06d639-03bb-45e6-9430-1b37a9b91733 admin admin] PATH_INFO: `/v3/projects/1ec38c21388f4166926646feff698da2/users/84ae7b3ce8fb44f990cf7045eb6b188a/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.344675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06d639-03bb-45e6-9430-1b37a9b91733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec38c21388f4166926646feff698da2, user_id=84ae7b3ce8fb44f990cf7045eb6b188a, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:46.348473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06d639-03bb-45e6-9430-1b37a9b91733 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:46.387213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 817/1633] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:46.394360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975ca6-9c84-4ebb-b408-4c0411378c53 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.394583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975ca6-9c84-4ebb-b408-4c0411378c53 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.394860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40975ca6-9c84-4ebb-b408-4c0411378c53 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.396524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 818/1634] 10.222.0.16 () {54 vars in 912 bytes} [Thu Sep 22 14:39:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:39:46.403531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40975ca6-9c84-4ebb-b408-4c0411378c53 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:46.421312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40975ca6-9c84-4ebb-b408-4c0411378c53 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.430120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d10e07-1acf-4448-81a8-8a6ccd0dcb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.431636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d10e07-1acf-4448-81a8-8a6ccd0dcb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.432228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d10e07-1acf-4448-81a8-8a6ccd0dcb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.432749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d10e07-1acf-4448-81a8-8a6ccd0dcb00 admin admin] PATH_INFO: `/v3/projects/686f08e2bc82498aade6cdbcdfc18e2b/users/bb30936f56e74e979362972f5541b4d3/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.455594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d10e07-1acf-4448-81a8-8a6ccd0dcb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686f08e2bc82498aade6cdbcdfc18e2b, user_id=bb30936f56e74e979362972f5541b4d3, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:46.459005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d10e07-1acf-4448-81a8-8a6ccd0dcb00 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:46.470096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 817/1635] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:46 2022] PUT /identity/v3/projects/1ec38c21388f4166926646feff698da2/users/84ae7b3ce8fb44f990cf7045eb6b188a/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:46.471358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d639-03bb-45e6-9430-1b37a9b91733 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:46.531000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 819/1636] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:46 2022] PUT /identity/v3/projects/686f08e2bc82498aade6cdbcdfc18e2b/users/bb30936f56e74e979362972f5541b4d3/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:46.532709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7e9c1-e2cf-4adc-b016-881679a143c7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.533567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7e9c1-e2cf-4adc-b016-881679a143c7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.534143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7e9c1-e2cf-4adc-b016-881679a143c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.558394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:46.574539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-35e7e9c1-e2cf-4adc-b016-881679a143c7 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:46.576067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-35e7e9c1-e2cf-4adc-b016-881679a143c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:46.579427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06d639-03bb-45e6-9430-1b37a9b91733 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.591074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:46.663463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa622-baf8-4563-a82d-11c178523ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.663463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa622-baf8-4563-a82d-11c178523ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.663463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa622-baf8-4563-a82d-11c178523ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.663463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa622-baf8-4563-a82d-11c178523ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.673530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 820/1637] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:39:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:46.675138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7e9c1-e2cf-4adc-b016-881679a143c7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:46.753211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7e9c1-e2cf-4adc-b016-881679a143c7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.761997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2797-92cb-42cb-82be-536fc656d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.762593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2797-92cb-42cb-82be-536fc656d2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.763215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2797-92cb-42cb-82be-536fc656d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.763498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c2797-92cb-42cb-82be-536fc656d2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.764208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c2797-92cb-42cb-82be-536fc656d2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:46.765990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c2797-92cb-42cb-82be-536fc656d2a6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:46.777018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa622-baf8-4563-a82d-11c178523ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:46.778839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa622-baf8-4563-a82d-11c178523ac0 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:46.788351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 821/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:46.789255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2797-92cb-42cb-82be-536fc656d2a6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:46.792515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 818/1639] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:46.793606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa622-baf8-4563-a82d-11c178523ac0 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:46.800376 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c2797-92cb-42cb-82be-536fc656d2a6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.803373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa622-baf8-4563-a82d-11c178523ac0 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:46.807282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dc2ae-9334-4143-ae39-b4c86ffda54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.807995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064967-0b54-4da6-9bb7-8f6f5ebac79e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:46.808644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc2ae-9334-4143-ae39-b4c86ffda54a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.808947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064967-0b54-4da6-9bb7-8f6f5ebac79e service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:46.809088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc2ae-9334-4143-ae39-b4c86ffda54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.809235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dc2ae-9334-4143-ae39-b4c86ffda54a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:46.809357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064967-0b54-4da6-9bb7-8f6f5ebac79e service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:46.809693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064967-0b54-4da6-9bb7-8f6f5ebac79e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.210801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dc2ae-9334-4143-ae39-b4c86ffda54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:47.210801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dc2ae-9334-4143-ae39-b4c86ffda54a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:47.212621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064967-0b54-4da6-9bb7-8f6f5ebac79e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:47.214166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 822/1640] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:47.214680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064967-0b54-4da6-9bb7-8f6f5ebac79e service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:47.214987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236f68-de05-4eaf-8c2a-a55250a194ac None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.214987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236f68-de05-4eaf-8c2a-a55250a194ac None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.214987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e236f68-de05-4eaf-8c2a-a55250a194ac None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.214987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 823/1641] 10.222.0.16 () {54 vars in 912 bytes} [Thu Sep 22 14:39:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:39:47.214987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236f68-de05-4eaf-8c2a-a55250a194ac None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:47.214987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e236f68-de05-4eaf-8c2a-a55250a194ac None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:47.216933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 819/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:47.216933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064967-0b54-4da6-9bb7-8f6f5ebac79e service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:47.218311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bdc8a-c63e-4deb-a3e0-07ff9f19a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:47.218311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bdc8a-c63e-4deb-a3e0-07ff9f19a87a admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.218311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bdc8a-c63e-4deb-a3e0-07ff9f19a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.218311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bdc8a-c63e-4deb-a3e0-07ff9f19a87a admin admin] PATH_INFO: `/v3/projects/1ec38c21388f4166926646feff698da2/users/84ae7b3ce8fb44f990cf7045eb6b188a/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.218644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bdc8a-c63e-4deb-a3e0-07ff9f19a87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec38c21388f4166926646feff698da2, user_id=84ae7b3ce8fb44f990cf7045eb6b188a, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:47.218644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bdc8a-c63e-4deb-a3e0-07ff9f19a87a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:47.218830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064967-0b54-4da6-9bb7-8f6f5ebac79e service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:47.218830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05d7c1-0005-4108-92b8-762fb0a4ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:47.218830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05d7c1-0005-4108-92b8-762fb0a4ab36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.218830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05d7c1-0005-4108-92b8-762fb0a4ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.219672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05d7c1-0005-4108-92b8-762fb0a4ab36 admin admin] PATH_INFO: `/v3/projects/686f08e2bc82498aade6cdbcdfc18e2b/users/bb30936f56e74e979362972f5541b4d3/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.219672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05d7c1-0005-4108-92b8-762fb0a4ab36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=686f08e2bc82498aade6cdbcdfc18e2b, user_id=bb30936f56e74e979362972f5541b4d3, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:47.219672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05d7c1-0005-4108-92b8-762fb0a4ab36 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:47.219918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 824/1643] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:46 2022] PUT /identity/v3/projects/1ec38c21388f4166926646feff698da2/users/84ae7b3ce8fb44f990cf7045eb6b188a/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:47.219918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9d8c-b6d7-4dfa-bbcf-2755d9123dfd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.219918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9d8c-b6d7-4dfa-bbcf-2755d9123dfd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.219918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec9d8c-b6d7-4dfa-bbcf-2755d9123dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.220241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 820/1644] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:46 2022] PUT /identity/v3/projects/686f08e2bc82498aade6cdbcdfc18e2b/users/bb30936f56e74e979362972f5541b4d3/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:47.220241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278862c9-4e7b-4448-8b1b-f91e7e9f92c8 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.220241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278862c9-4e7b-4448-8b1b-f91e7e9f92c8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.220241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278862c9-4e7b-4448-8b1b-f91e7e9f92c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.220575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e5ec9d8c-b6d7-4dfa-bbcf-2755d9123dfd None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:47.220575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e5ec9d8c-b6d7-4dfa-bbcf-2755d9123dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:47.220717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-278862c9-4e7b-4448-8b1b-f91e7e9f92c8 None None] MFA Rules not processed for user `84ae7b3ce8fb44f990cf7045eb6b188a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:47.220717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-278862c9-4e7b-4448-8b1b-f91e7e9f92c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:47.220893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 825/1645] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:39:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:47.220893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bb855-1a79-43ea-99f2-180e76509194 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.220893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bb855-1a79-43ea-99f2-180e76509194 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.220893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bb855-1a79-43ea-99f2-180e76509194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.221169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 821/1646] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:47.221241 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-930bb855-1a79-43ea-99f2-180e76509194 None None] MFA Rules not processed for user `bb30936f56e74e979362972f5541b4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:47.221241 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-930bb855-1a79-43ea-99f2-180e76509194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:47.221372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278862c9-4e7b-4448-8b1b-f91e7e9f92c8 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:47.221372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278862c9-4e7b-4448-8b1b-f91e7e9f92c8 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:47.221372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5a3b3-7b20-46ca-8956-9e3caa2619c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:47.221372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a3b3-7b20-46ca-8956-9e3caa2619c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.221640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a3b3-7b20-46ca-8956-9e3caa2619c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.221640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a3b3-7b20-46ca-8956-9e3caa2619c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.221640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5a3b3-7b20-46ca-8956-9e3caa2619c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:47.221640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5a3b3-7b20-46ca-8956-9e3caa2619c2 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:47.222058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 826/1647] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:47.222171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 822/1648] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:47.261928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bb855-1a79-43ea-99f2-180e76509194 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:47.275372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bb855-1a79-43ea-99f2-180e76509194 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:47.277176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb0bdf-9554-4b04-b256-b9e6d8e8ef62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:47.277176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0bdf-9554-4b04-b256-b9e6d8e8ef62 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.277421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0bdf-9554-4b04-b256-b9e6d8e8ef62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.277607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0bdf-9554-4b04-b256-b9e6d8e8ef62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.296614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:47.298784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb0bdf-9554-4b04-b256-b9e6d8e8ef62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:47.300454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb0bdf-9554-4b04-b256-b9e6d8e8ef62 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:47.330751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 827/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:47.726557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:47.790142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5a3b3-7b20-46ca-8956-9e3caa2619c2 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:47.799551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5a3b3-7b20-46ca-8956-9e3caa2619c2 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:47.804422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ad7e9-575b-4682-8488-c26e22e1e163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:47.805310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad7e9-575b-4682-8488-c26e22e1e163 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:47.805720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad7e9-575b-4682-8488-c26e22e1e163 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:47.806107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ad7e9-575b-4682-8488-c26e22e1e163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:47.817459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ad7e9-575b-4682-8488-c26e22e1e163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:47.819135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ad7e9-575b-4682-8488-c26e22e1e163 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:47.830357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 823/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:48.071076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb0bdf-9554-4b04-b256-b9e6d8e8ef62 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:48.080981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb0bdf-9554-4b04-b256-b9e6d8e8ef62 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:48.085541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58a08-5aaf-490a-89e8-874c37798cfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:48.086200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58a08-5aaf-490a-89e8-874c37798cfc service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:48.086490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58a08-5aaf-490a-89e8-874c37798cfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:48.086767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58a08-5aaf-490a-89e8-874c37798cfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:48.157887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb58a08-5aaf-490a-89e8-874c37798cfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:48.159609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb58a08-5aaf-490a-89e8-874c37798cfc service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:48.182968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 828/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:48.314981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ad7e9-575b-4682-8488-c26e22e1e163 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:48.449166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58a08-5aaf-490a-89e8-874c37798cfc service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:48.478887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58a08-5aaf-490a-89e8-874c37798cfc service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:48.481797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ad7e9-575b-4682-8488-c26e22e1e163 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:48.487726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:48.488428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:48.488713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:48.489132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] PATH_INFO: `/v3/users/f7cc2925a9e34e34a8bf27ce8e213cb4` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:48.492273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7cc2925a9e34e34a8bf27ce8e213cb4)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:48.493013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: WARNING py.warnings [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:39:48.493013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: warnings.warn(msg) Sep 22 14:39:48.493013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: Sep 22 14:39:48.495010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:48.498231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a34484-656f-4aae-84c1-ba70d1f6dc3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:48.499689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a34484-656f-4aae-84c1-ba70d1f6dc3d service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:48.500169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a34484-656f-4aae-84c1-ba70d1f6dc3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:48.501068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a34484-656f-4aae-84c1-ba70d1f6dc3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:48.599834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a34484-656f-4aae-84c1-ba70d1f6dc3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:48.602027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a34484-656f-4aae-84c1-ba70d1f6dc3d service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:48.612434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 829/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:48.827477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7cc2925a9e34e34a8bf27ce8e213cb4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:48.829066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7cc2925a9e34e34a8bf27ce8e213cb4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:48.865367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7cc2925a9e34e34a8bf27ce8e213cb4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:48.904209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7cc2925a9e34e34a8bf27ce8e213cb4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:48.905319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7cc2925a9e34e34a8bf27ce8e213cb4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:49.012669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 824/1653] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:39:48 2022] DELETE /identity/v3/users/f7cc2925a9e34e34a8bf27ce8e213cb4 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:49.018137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43476f43-d2dc-4736-8c49-c531321ba967 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:49.018696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43476f43-d2dc-4736-8c49-c531321ba967 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:49.018696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43476f43-d2dc-4736-8c49-c531321ba967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:49.059185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-43476f43-d2dc-4736-8c49-c531321ba967 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:49.060452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-43476f43-d2dc-4736-8c49-c531321ba967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:49.090660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:49.194603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 830/1654] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:49.207488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:49.209457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:49.254938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:49.424758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c95186-3c3b-4a99-8a49-895bfdc58e56 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:49.439970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c341-aeb6-40e1-a51f-47248d46dbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:49.440708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c341-aeb6-40e1-a51f-47248d46dbcc service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:49.440869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c341-aeb6-40e1-a51f-47248d46dbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:49.441296 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c341-aeb6-40e1-a51f-47248d46dbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:49.471239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c341-aeb6-40e1-a51f-47248d46dbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:49.472905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c341-aeb6-40e1-a51f-47248d46dbcc service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:49.514683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 825/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:50.507895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43476f43-d2dc-4736-8c49-c531321ba967 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:50.511212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-43476f43-d2dc-4736-8c49-c531321ba967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:50.548310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43476f43-d2dc-4736-8c49-c531321ba967 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:50.555213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:50.556981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:50.556981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:50.556981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] PATH_INFO: `/v3/projects/2eca605d3ff848caaa205b362a26f643` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:50.568732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eca605d3ff848caaa205b362a26f643)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:50.568732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 22 14:39:50.568732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 22 14:39:50.568732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: Sep 22 14:39:50.592782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:50.917880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eca605d3ff848caaa205b362a26f643', 'request_id': 'req-36510205-d921-476f-9f81-23c942eeae03'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:51.091594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eca605d3ff848caaa205b362a26f643', 'request_id': 'req-36510205-d921-476f-9f81-23c942eeae03'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:51.100171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eca605d3ff848caaa205b362a26f643', 'request_id': 'req-36510205-d921-476f-9f81-23c942eeae03'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:51.165876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] The token cache is being invalidate because project 2eca605d3ff848caaa205b362a26f643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:39:51.166403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:51.167274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36510205-d921-476f-9f81-23c942eeae03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:51.169946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 831/1656] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:39:50 2022] DELETE /identity/v3/projects/2eca605d3ff848caaa205b362a26f643 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:51.174090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea5ea-eba7-44d2-811a-d370e7054102 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:51.174950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea5ea-eba7-44d2-811a-d370e7054102 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:51.175230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea5ea-eba7-44d2-811a-d370e7054102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:51.223361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-865ea5ea-eba7-44d2-811a-d370e7054102 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:51.235466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-865ea5ea-eba7-44d2-811a-d370e7054102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:51.366438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 826/1657] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:39:51.375353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92179e-6b7f-41d8-8933-9bc885b7a2e0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:51.375353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92179e-6b7f-41d8-8933-9bc885b7a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:51.375353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92179e-6b7f-41d8-8933-9bc885b7a2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:51.430781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5e92179e-6b7f-41d8-8933-9bc885b7a2e0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:51.434446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5e92179e-6b7f-41d8-8933-9bc885b7a2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:51.472965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 832/1658] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:51.478705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ea5ea-eba7-44d2-811a-d370e7054102 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:51.501781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ea5ea-eba7-44d2-811a-d370e7054102 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:51.512242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:51.512877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:51.513158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:51.513835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:51.518626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:51.521209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:51.531022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:51.562119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 827/1659] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:51.566946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92179e-6b7f-41d8-8933-9bc885b7a2e0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:51.581128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92179e-6b7f-41d8-8933-9bc885b7a2e0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:51.595798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:51.599312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:51.600591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:51.601424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:51.602739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:51.608327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:51.749190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 833/1660] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:51 2022] POST /identity/v3/projects => generated 363 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:51.753493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:51.780046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9900dca-5774-4dd8-a2ed-ce78c3b149ce admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:51.874642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:51.880119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:52.029524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9091ff-b80b-48cd-8c28-0b60dc45ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:52.030903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9091ff-b80b-48cd-8c28-0b60dc45ca5d admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:52.031284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9091ff-b80b-48cd-8c28-0b60dc45ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:52.031593 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9091ff-b80b-48cd-8c28-0b60dc45ca5d admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:52.035091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9091ff-b80b-48cd-8c28-0b60dc45ca5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:52.039932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9091ff-b80b-48cd-8c28-0b60dc45ca5d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:52.112314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547048c5-892f-4cd0-92ab-64a1f2801315 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:52.119348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:52.120072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:52.120557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:52.121102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] PATH_INFO: `/v3/users/df62a159c08f48648c1eede93f79f282` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:52.122559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df62a159c08f48648c1eede93f79f282)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:52.125440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:52.163788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:52.174239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 828/1661] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:51 2022] POST /identity/v3/users => generated 282 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:52.178425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9091ff-b80b-48cd-8c28-0b60dc45ca5d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:52.205033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9091ff-b80b-48cd-8c28-0b60dc45ca5d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:52.214545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb9cec-cfe0-4288-a125-225d15bac32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:52.215565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9cec-cfe0-4288-a125-225d15bac32a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:52.216013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9cec-cfe0-4288-a125-225d15bac32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:52.216908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb9cec-cfe0-4288-a125-225d15bac32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:52.218552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb9cec-cfe0-4288-a125-225d15bac32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:52.220719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb9cec-cfe0-4288-a125-225d15bac32a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:52.248362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 829/1662] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:39:52.255845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb9cec-cfe0-4288-a125-225d15bac32a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:52.269731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb9cec-cfe0-4288-a125-225d15bac32a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:52.282502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00336e21-70bf-43e4-9f86-fac3afb0341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:52.283476 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00336e21-70bf-43e4-9f86-fac3afb0341a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:52.283981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00336e21-70bf-43e4-9f86-fac3afb0341a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:52.285185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00336e21-70bf-43e4-9f86-fac3afb0341a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:52.309104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00336e21-70bf-43e4-9f86-fac3afb0341a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:52.315343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00336e21-70bf-43e4-9f86-fac3afb0341a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:52.339655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 830/1663] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:39:52.343434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00336e21-70bf-43e4-9f86-fac3afb0341a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:52.363039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00336e21-70bf-43e4-9f86-fac3afb0341a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:52.400711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca55c8c-25e8-4010-9da6-2006f7b3253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:52.402452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55c8c-25e8-4010-9da6-2006f7b3253a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:52.402739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55c8c-25e8-4010-9da6-2006f7b3253a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:52.403029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca55c8c-25e8-4010-9da6-2006f7b3253a admin admin] PATH_INFO: `/v3/projects/983b28afc2f5403a9fde90ddd7e45595/users/6dcf09738d5449e1a0d634755e46e60d/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:52.409785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df62a159c08f48648c1eede93f79f282'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:52.429540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df62a159c08f48648c1eede93f79f282'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:52.451528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:52.474979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca55c8c-25e8-4010-9da6-2006f7b3253a admin admin] RBAC: Authorizing `identity:create_grant(project_id=983b28afc2f5403a9fde90ddd7e45595, user_id=6dcf09738d5449e1a0d634755e46e60d, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:52.477739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca55c8c-25e8-4010-9da6-2006f7b3253a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:52.524970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df62a159c08f48648c1eede93f79f282'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:52.528357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df62a159c08f48648c1eede93f79f282'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:52.553474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ba8d0dc9-3397-444c-b2e8-2959fcadf2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df62a159c08f48648c1eede93f79f282'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:52.576911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 834/1664] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:39:51 2022] DELETE /identity/v3/users/df62a159c08f48648c1eede93f79f282 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:52.583968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd678d7-61aa-4284-82ad-edb0eaf335da None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:52.585020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd678d7-61aa-4284-82ad-edb0eaf335da None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:52.588626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd678d7-61aa-4284-82ad-edb0eaf335da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:52.622609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 831/1665] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:52 2022] PUT /identity/v3/projects/983b28afc2f5403a9fde90ddd7e45595/users/6dcf09738d5449e1a0d634755e46e60d/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:39:52.624762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6cd678d7-61aa-4284-82ad-edb0eaf335da None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:52.628302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6cd678d7-61aa-4284-82ad-edb0eaf335da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:52.635038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075970-81df-4110-95c2-17188e05b4e7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:52.635325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075970-81df-4110-95c2-17188e05b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:52.635596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075970-81df-4110-95c2-17188e05b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:52.710114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-36075970-81df-4110-95c2-17188e05b4e7 None None] MFA Rules not processed for user `6dcf09738d5449e1a0d634755e46e60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:52.711858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-36075970-81df-4110-95c2-17188e05b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:52.803295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 835/1666] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:52.839534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd678d7-61aa-4284-82ad-edb0eaf335da None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:52.840998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6cd678d7-61aa-4284-82ad-edb0eaf335da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:52.889148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 832/1667] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:39:52.890345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36075970-81df-4110-95c2-17188e05b4e7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:52.891690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-36075970-81df-4110-95c2-17188e05b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:52.921009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36075970-81df-4110-95c2-17188e05b4e7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:52.936742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ccd71-7631-4e6b-bcd9-a2629ca6df77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:52.942525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ccd71-7631-4e6b-bcd9-a2629ca6df77 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:52.942852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ccd71-7631-4e6b-bcd9-a2629ca6df77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:52.943128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ccd71-7631-4e6b-bcd9-a2629ca6df77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:52.943827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ccd71-7631-4e6b-bcd9-a2629ca6df77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:52.953704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ccd71-7631-4e6b-bcd9-a2629ca6df77 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:52.989318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd678d7-61aa-4284-82ad-edb0eaf335da None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:53.003811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef233b3-1170-4ab8-80e3-dd9ed6aa0113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:53.004556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef233b3-1170-4ab8-80e3-dd9ed6aa0113 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:53.005043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef233b3-1170-4ab8-80e3-dd9ed6aa0113 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:53.005454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef233b3-1170-4ab8-80e3-dd9ed6aa0113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:53.030375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef233b3-1170-4ab8-80e3-dd9ed6aa0113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:53.031855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef233b3-1170-4ab8-80e3-dd9ed6aa0113 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:53.055888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 836/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:39:53.102714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 833/1669] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:52 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:53.106448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef233b3-1170-4ab8-80e3-dd9ed6aa0113 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:53.119240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef233b3-1170-4ab8-80e3-dd9ed6aa0113 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:53.260005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dc92e-63b2-4436-a746-1668920d3c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:53.260673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dc92e-63b2-4436-a746-1668920d3c27 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:53.260957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dc92e-63b2-4436-a746-1668920d3c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:53.261231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dc92e-63b2-4436-a746-1668920d3c27 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:53.261897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dc92e-63b2-4436-a746-1668920d3c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:53.271336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dc92e-63b2-4436-a746-1668920d3c27 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:53.369782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 837/1670] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:53 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:53.373635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ccd71-7631-4e6b-bcd9-a2629ca6df77 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:53.387726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ccd71-7631-4e6b-bcd9-a2629ca6df77 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:53.393815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cc180-d5d1-4c56-8dd7-f142e379138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:53.396321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cc180-d5d1-4c56-8dd7-f142e379138f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:53.397230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cc180-d5d1-4c56-8dd7-f142e379138f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:53.397536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cc180-d5d1-4c56-8dd7-f142e379138f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:53.398746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cc180-d5d1-4c56-8dd7-f142e379138f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:53.405860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cc180-d5d1-4c56-8dd7-f142e379138f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:53.421534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 834/1671] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:39:53.425558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dc92e-63b2-4436-a746-1668920d3c27 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:53.438077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dc92e-63b2-4436-a746-1668920d3c27 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:53.443900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5599e-9091-401e-9c04-d5ee180ddc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:53.444591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5599e-9091-401e-9c04-d5ee180ddc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:53.444880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5599e-9091-401e-9c04-d5ee180ddc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:53.445270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5599e-9091-401e-9c04-d5ee180ddc14 admin admin] PATH_INFO: `/v3/projects/a6cbd888a8a2451faf5a3d541172150c/users/e30f035ed40d446b86d63cacf68dd9cf/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:53.464373 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5599e-9091-401e-9c04-d5ee180ddc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cbd888a8a2451faf5a3d541172150c, user_id=e30f035ed40d446b86d63cacf68dd9cf, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:53.469249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5599e-9091-401e-9c04-d5ee180ddc14 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:53.569731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cc180-d5d1-4c56-8dd7-f142e379138f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:53.570443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 838/1672] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:53 2022] PUT /identity/v3/projects/a6cbd888a8a2451faf5a3d541172150c/users/e30f035ed40d446b86d63cacf68dd9cf/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:53.587930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cc180-d5d1-4c56-8dd7-f142e379138f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:53.751783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad6688-d088-4161-a60d-522ae82f7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:53.751783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6688-d088-4161-a60d-522ae82f7e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:53.751783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6688-d088-4161-a60d-522ae82f7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:53.751783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6688-d088-4161-a60d-522ae82f7e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:53.753795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad6688-d088-4161-a60d-522ae82f7e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:53.758767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad6688-d088-4161-a60d-522ae82f7e40 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:53.782058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 835/1673] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:53.782953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5599e-9091-401e-9c04-d5ee180ddc14 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:53.794979 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5599e-9091-401e-9c04-d5ee180ddc14 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:53.803885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:53.805267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:53.805736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:53.806256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] PATH_INFO: `/v3/projects/a6cbd888a8a2451faf5a3d541172150c/users/e30f035ed40d446b86d63cacf68dd9cf/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:53.810512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cbd888a8a2451faf5a3d541172150c, user_id=e30f035ed40d446b86d63cacf68dd9cf, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:53.816599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:53.864875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 839/1674] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:53 2022] PUT /identity/v3/projects/a6cbd888a8a2451faf5a3d541172150c/users/e30f035ed40d446b86d63cacf68dd9cf/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:39:53.865723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55302e9-0a6a-46b8-ba06-d0178b88c4c8 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:53.878201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55302e9-0a6a-46b8-ba06-d0178b88c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:53.878562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55302e9-0a6a-46b8-ba06-d0178b88c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:53.950494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a55302e9-0a6a-46b8-ba06-d0178b88c4c8 None None] MFA Rules not processed for user `e30f035ed40d446b86d63cacf68dd9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:53.952072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a55302e9-0a6a-46b8-ba06-d0178b88c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:54.125412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 836/1675] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:54.213387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:54.216684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:54.262085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:54.433326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625792-b541-45a8-bef5-3b65a5a98ef7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:54.443504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:54.444940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:54.445695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:54.446207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] PATH_INFO: `/v3/projects/8db292e37b21403f9338784373e366cd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:54.448779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db292e37b21403f9338784373e366cd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:54.451243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:54.541614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55302e9-0a6a-46b8-ba06-d0178b88c4c8 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:54.544652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a55302e9-0a6a-46b8-ba06-d0178b88c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:54.628442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:54.654253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db292e37b21403f9338784373e366cd', 'request_id': 'req-f4945993-f8ef-448f-95cd-adcd5902b44c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:54.722477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55302e9-0a6a-46b8-ba06-d0178b88c4c8 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:54.764574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db292e37b21403f9338784373e366cd', 'request_id': 'req-f4945993-f8ef-448f-95cd-adcd5902b44c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:54.773412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db292e37b21403f9338784373e366cd', 'request_id': 'req-f4945993-f8ef-448f-95cd-adcd5902b44c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:54.804082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] The token cache is being invalidate because project 8db292e37b21403f9338784373e366cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:39:54.805719 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:54.808405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:54.812081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 840/1676] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:39:54 2022] DELETE /identity/v3/projects/8db292e37b21403f9338784373e366cd => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:54.819189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:54.827098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:54.842622 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:54.844127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:54.844950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:54.845534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:54.851050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:55.007498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:55.011717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:55.033015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4945993-f8ef-448f-95cd-adcd5902b44c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:55.045100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:55.046927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:55.048307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:55.050228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] PATH_INFO: `/v3/users/bb30936f56e74e979362972f5541b4d3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:55.052001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb30936f56e74e979362972f5541b4d3)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:55.054224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 837/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:55.070737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:55.351071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb30936f56e74e979362972f5541b4d3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:55.356934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:55.358785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:55.377882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c73cb-aa15-4613-989c-2768c9fa7d37 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:55.384377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb30936f56e74e979362972f5541b4d3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:55.396549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:55.397391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:55.397823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:55.398155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:55.402515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:55.478746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb30936f56e74e979362972f5541b4d3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:55.479621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb30936f56e74e979362972f5541b4d3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:55.490875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb30936f56e74e979362972f5541b4d3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:55.510620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 841/1678] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:39:54 2022] DELETE /identity/v3/users/bb30936f56e74e979362972f5541b4d3 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:55.537213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:55.539493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:55.584353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 838/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:56.439277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:56.515824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:56.517709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:56.751533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705641-2ab2-4358-9571-95b9215430bb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:56.774815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:56.775497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:56.775780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:56.776056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] PATH_INFO: `/v3/users/5092f81bef514c83b75a5315952f5555` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:56.777317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5092f81bef514c83b75a5315952f5555)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:56.779325 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:57.160141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5092f81bef514c83b75a5315952f5555'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.207096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5092f81bef514c83b75a5315952f5555'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.259596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:57.283208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5092f81bef514c83b75a5315952f5555'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.288178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5092f81bef514c83b75a5315952f5555'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.298463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df6be3-5da8-48fa-9bd4-4e7a15fb57a6 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:57.307558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-649677bf-7cfb-4f98-9740-0e6e615052be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5092f81bef514c83b75a5315952f5555'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.322705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:57.323375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:57.323654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:57.323929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] PATH_INFO: `/v3/projects/686f08e2bc82498aade6cdbcdfc18e2b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:57.334877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686f08e2bc82498aade6cdbcdfc18e2b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:57.336216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 842/1680] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:39:56 2022] DELETE /identity/v3/users/5092f81bef514c83b75a5315952f5555 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:57.344927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340d4d-90b5-45a2-bd71-04697ac0f5f8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:57.345640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340d4d-90b5-45a2-bd71-04697ac0f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:57.346069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:57.346979 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340d4d-90b5-45a2-bd71-04697ac0f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:57.407798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-96340d4d-90b5-45a2-bd71-04697ac0f5f8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:57.409361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-96340d4d-90b5-45a2-bd71-04697ac0f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:57.445116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:57.569331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686f08e2bc82498aade6cdbcdfc18e2b', 'request_id': 'req-2268aa2b-9ef0-47ba-9829-5041766f39d8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.588845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 843/1681] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:57.590824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0ba20-e990-46bb-9fa6-49a6244e5929 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:57.591273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0ba20-e990-46bb-9fa6-49a6244e5929 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:57.591884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0ba20-e990-46bb-9fa6-49a6244e5929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:57.655647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686f08e2bc82498aade6cdbcdfc18e2b', 'request_id': 'req-2268aa2b-9ef0-47ba-9829-5041766f39d8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.664305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686f08e2bc82498aade6cdbcdfc18e2b', 'request_id': 'req-2268aa2b-9ef0-47ba-9829-5041766f39d8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.699840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] The token cache is being invalidate because project 686f08e2bc82498aade6cdbcdfc18e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:39:57.701403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.710657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:39:57.717762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 839/1682] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:39:57 2022] DELETE /identity/v3/projects/686f08e2bc82498aade6cdbcdfc18e2b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:39:57.719572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:57.721544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:57.730942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c0a0ba20-e990-46bb-9fa6-49a6244e5929 None None] MFA Rules not processed for user `e31c29dd5cbb4ede8989904bfe4416ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:57.732962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c0a0ba20-e990-46bb-9fa6-49a6244e5929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:57.875558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268aa2b-9ef0-47ba-9829-5041766f39d8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:57.888570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:57.890578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:57.891061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:57.892324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:57.899224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:57.915029 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 844/1683] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:57.918206 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fe95-d88b-4892-8be4-4a0724e5b4ef None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:57.921125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fe95-d88b-4892-8be4-4a0724e5b4ef None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:57.921571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fe95-d88b-4892-8be4-4a0724e5b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:57.997962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1ca4fe95-d88b-4892-8be4-4a0724e5b4ef None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:57.999237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1ca4fe95-d88b-4892-8be4-4a0724e5b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:58.055313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:58.060016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:58.149923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 840/1684] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:58.151238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:58.157168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:58.169108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:39:58.171743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 845/1685] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:58.173253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aecba-e376-4246-897a-1814655d1206 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:58.173784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aecba-e376-4246-897a-1814655d1206 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:58.174259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aecba-e376-4246-897a-1814655d1206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:58.240405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-526aecba-e376-4246-897a-1814655d1206 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:58.252493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-526aecba-e376-4246-897a-1814655d1206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:58.293031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 846/1686] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:58.299474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aecba-e376-4246-897a-1814655d1206 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:58.336468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aecba-e376-4246-897a-1814655d1206 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:58.368829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:58.369638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:58.369930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:58.371246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:58.372332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:39:58.374696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:58.376596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:58.386190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda6a07-f429-4d74-9bd7-805744d069a4 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:58.397370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa3677-4341-4c07-a049-94cfbac6ec66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:58.398519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3677-4341-4c07-a049-94cfbac6ec66 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:58.399001 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3677-4341-4c07-a049-94cfbac6ec66 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:58.400071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3677-4341-4c07-a049-94cfbac6ec66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:58.412122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa3677-4341-4c07-a049-94cfbac6ec66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:58.424027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa3677-4341-4c07-a049-94cfbac6ec66 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:58.437575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 841/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:39:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:39:58.455225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 847/1688] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:39:58.459440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa3677-4341-4c07-a049-94cfbac6ec66 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:58.478050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa3677-4341-4c07-a049-94cfbac6ec66 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:58.490189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819dc0-7b3a-4935-9601-81f01ba41942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:58.490189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819dc0-7b3a-4935-9601-81f01ba41942 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:58.490189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819dc0-7b3a-4935-9601-81f01ba41942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:58.490189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819dc0-7b3a-4935-9601-81f01ba41942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:58.490532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb819dc0-7b3a-4935-9601-81f01ba41942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:58.490532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb819dc0-7b3a-4935-9601-81f01ba41942 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:58.651371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:58.651909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 842/1689] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:58 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:39:58.664064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9285d-253f-4b3e-a9a5-c74b35c5ba84 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:58.769249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600c57a-2621-46ba-82f9-bc6ea2a52550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:58.772489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600c57a-2621-46ba-82f9-bc6ea2a52550 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:58.772788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600c57a-2621-46ba-82f9-bc6ea2a52550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:58.773067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600c57a-2621-46ba-82f9-bc6ea2a52550 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:58.773722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600c57a-2621-46ba-82f9-bc6ea2a52550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:58.784767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600c57a-2621-46ba-82f9-bc6ea2a52550 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:58.936485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 848/1690] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:58 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:39:58.946780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819dc0-7b3a-4935-9601-81f01ba41942 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:58.981775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819dc0-7b3a-4935-9601-81f01ba41942 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:58.992965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bed25-3969-49e5-aaed-0df34b174117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:58.994673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bed25-3969-49e5-aaed-0df34b174117 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:58.995244 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bed25-3969-49e5-aaed-0df34b174117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:58.995706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bed25-3969-49e5-aaed-0df34b174117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:58.997391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bed25-3969-49e5-aaed-0df34b174117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:58.999446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bed25-3969-49e5-aaed-0df34b174117 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:59.020889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 843/1691] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:59.028699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600c57a-2621-46ba-82f9-bc6ea2a52550 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:59.046930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600c57a-2621-46ba-82f9-bc6ea2a52550 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:59.062714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8775864-678d-419f-b556-90b176a76d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:59.063769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8775864-678d-419f-b556-90b176a76d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:59.064534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8775864-678d-419f-b556-90b176a76d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:59.068757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8775864-678d-419f-b556-90b176a76d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:59.068757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8775864-678d-419f-b556-90b176a76d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:59.074556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8775864-678d-419f-b556-90b176a76d4f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:59.125726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bed25-3969-49e5-aaed-0df34b174117 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:59.127163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 849/1692] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:39:59.166835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bed25-3969-49e5-aaed-0df34b174117 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:59.175742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:59.176490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:59.176830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:59.177141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] PATH_INFO: `/v3/projects/726c7dbd53b04135936ce844d1302e25/users/b312e9920a36489389bed0f031ae1f12/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:59.234536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726c7dbd53b04135936ce844d1302e25, user_id=b312e9920a36489389bed0f031ae1f12, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:59.237247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:59.422920 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 844/1693] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:39:59 2022] PUT /identity/v3/projects/726c7dbd53b04135936ce844d1302e25/users/b312e9920a36489389bed0f031ae1f12/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:39:59.434665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e84b3-e8ab-4c38-9773-a5d358cc11e0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:59.437375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e84b3-e8ab-4c38-9773-a5d358cc11e0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:59.437825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e84b3-e8ab-4c38-9773-a5d358cc11e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:59.499790 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:59.501627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:59.537145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4b5e84b3-e8ab-4c38-9773-a5d358cc11e0 None None] MFA Rules not processed for user `b312e9920a36489389bed0f031ae1f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:39:59.538900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4b5e84b3-e8ab-4c38-9773-a5d358cc11e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:39:59.714610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 850/1694] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:39:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:39:59.715795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e84b3-e8ab-4c38-9773-a5d358cc11e0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:39:59.727534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2feeb-e4cc-4e30-81e5-298381373056 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:59.734316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e84b3-e8ab-4c38-9773-a5d358cc11e0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:39:59.746387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:59.750393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:59.750393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:59.750393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] PATH_INFO: `/v3/projects/69fdf651bd394978b2415510a76ab61e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:59.750860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69fdf651bd394978b2415510a76ab61e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:59.751759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ace63-30ee-4c78-a667-4dee0ffb2530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:39:59.752501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ace63-30ee-4c78-a667-4dee0ffb2530 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:39:59.752621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:59.752941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ace63-30ee-4c78-a667-4dee0ffb2530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:39:59.753438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ace63-30ee-4c78-a667-4dee0ffb2530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:39:59.755407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ace63-30ee-4c78-a667-4dee0ffb2530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:39:59.757454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ace63-30ee-4c78-a667-4dee0ffb2530 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:39:59.931058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 851/1695] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:39:59 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:39:59.935749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ace63-30ee-4c78-a667-4dee0ffb2530 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:00.031348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69fdf651bd394978b2415510a76ab61e', 'request_id': 'req-feec3fc4-def2-4e0d-8653-c4603a52bc63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:00.034933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:00.131640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69fdf651bd394978b2415510a76ab61e', 'request_id': 'req-feec3fc4-def2-4e0d-8653-c4603a52bc63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:00.142947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69fdf651bd394978b2415510a76ab61e', 'request_id': 'req-feec3fc4-def2-4e0d-8653-c4603a52bc63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:00.149340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ace63-30ee-4c78-a667-4dee0ffb2530 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:00.175584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] The token cache is being invalidate because project 69fdf651bd394978b2415510a76ab61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:00.176854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:00.183120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-feec3fc4-def2-4e0d-8653-c4603a52bc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:00.189780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 845/1696] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:39:59 2022] DELETE /identity/v3/projects/69fdf651bd394978b2415510a76ab61e => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:00.198764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63e01-b3ac-49d2-8dec-6307e96bb58f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.199334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63e01-b3ac-49d2-8dec-6307e96bb58f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.199778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff63e01-b3ac-49d2-8dec-6307e96bb58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.235530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-cff63e01-b3ac-49d2-8dec-6307e96bb58f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:00.236776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cff63e01-b3ac-49d2-8dec-6307e96bb58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:00.280032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:00.285113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.287197 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.288112 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.303823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:00.312581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:00.366186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 846/1697] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:00.374092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ea096-9301-4e79-bb96-832fe479c65f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.374532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ea096-9301-4e79-bb96-832fe479c65f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.374886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ea096-9301-4e79-bb96-832fe479c65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.417818 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 852/1698] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:39:59 2022] POST /identity/v3/users => generated 292 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:00.422493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:00.431109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:00.431680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2b3ea096-9301-4e79-bb96-832fe479c65f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:00.435916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2b3ea096-9301-4e79-bb96-832fe479c65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:00.466236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3eb6-df54-4e18-bb87-547396b20edd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:00.476454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 847/1699] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:00.481432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ea096-9301-4e79-bb96-832fe479c65f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:00.486655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4661ed-235f-468a-b5c7-375a6d89988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:00.491957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4661ed-235f-468a-b5c7-375a6d89988d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.493750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4661ed-235f-468a-b5c7-375a6d89988d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.494879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4661ed-235f-468a-b5c7-375a6d89988d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.495780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4661ed-235f-468a-b5c7-375a6d89988d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:00.496390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ea096-9301-4e79-bb96-832fe479c65f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:00.505427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4661ed-235f-468a-b5c7-375a6d89988d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:00.512018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:00.512710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.512990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.513267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.513934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:00.514270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:00.517595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:00.550917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 848/1700] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:00.554302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:00.562961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 853/1701] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:00.569786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4661ed-235f-468a-b5c7-375a6d89988d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:00.580275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b741e0-18ea-4c9e-824a-3f9befb9ba46 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:00.593054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b856e24-4e99-441b-b0dd-34ab2f626b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:00.593682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b856e24-4e99-441b-b0dd-34ab2f626b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.593959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b856e24-4e99-441b-b0dd-34ab2f626b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.594279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b856e24-4e99-441b-b0dd-34ab2f626b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.595027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b856e24-4e99-441b-b0dd-34ab2f626b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:00.598418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b856e24-4e99-441b-b0dd-34ab2f626b25 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:00.602367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4661ed-235f-468a-b5c7-375a6d89988d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:00.611724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33774b8f-e337-410e-bb24-9a0fb8bd34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:00.614160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774b8f-e337-410e-bb24-9a0fb8bd34af admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.614710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774b8f-e337-410e-bb24-9a0fb8bd34af admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.615867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774b8f-e337-410e-bb24-9a0fb8bd34af admin admin] PATH_INFO: `/v3/projects/ab3653c349374e40b0645efad91d64a1/users/f5d53b48388848edb84e2bdd3b6a853b/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.672578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33774b8f-e337-410e-bb24-9a0fb8bd34af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3653c349374e40b0645efad91d64a1, user_id=f5d53b48388848edb84e2bdd3b6a853b, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:00.679736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33774b8f-e337-410e-bb24-9a0fb8bd34af admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:00.745900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 849/1702] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:00 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:00.750310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a7dd0-8082-45c2-852f-1b8023420f91 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.750659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a7dd0-8082-45c2-852f-1b8023420f91 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.750933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a7dd0-8082-45c2-852f-1b8023420f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.784776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 854/1703] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:00 2022] PUT /identity/v3/projects/ab3653c349374e40b0645efad91d64a1/users/f5d53b48388848edb84e2bdd3b6a853b/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:00.896659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33774b8f-e337-410e-bb24-9a0fb8bd34af admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:00.897392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-900a7dd0-8082-45c2-852f-1b8023420f91 None None] MFA Rules not processed for user `e4c7cd885cc24bf2934e4e9cecb50ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:00.897392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-900a7dd0-8082-45c2-852f-1b8023420f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:00.960663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33774b8f-e337-410e-bb24-9a0fb8bd34af admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:00.971836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca84d0f-464a-40db-bb6e-f18dfd90c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:00.973371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca84d0f-464a-40db-bb6e-f18dfd90c9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:00.974096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca84d0f-464a-40db-bb6e-f18dfd90c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:00.974804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca84d0f-464a-40db-bb6e-f18dfd90c9a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:00.977766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca84d0f-464a-40db-bb6e-f18dfd90c9a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:00.981127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca84d0f-464a-40db-bb6e-f18dfd90c9a8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:01.027346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 850/1704] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:01.028446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a7dd0-8082-45c2-852f-1b8023420f91 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:01.062086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:01.064427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a7dd0-8082-45c2-852f-1b8023420f91 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:01.078731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f8ba-e1c3-46c5-956c-f1cf551b12cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:01.079364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f8ba-e1c3-46c5-956c-f1cf551b12cc admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.079646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f8ba-e1c3-46c5-956c-f1cf551b12cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.079911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f8ba-e1c3-46c5-956c-f1cf551b12cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.080569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f8ba-e1c3-46c5-956c-f1cf551b12cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:01.085345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f8ba-e1c3-46c5-956c-f1cf551b12cc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:01.116056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 855/1705] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:00 2022] POST /identity/v3/users => generated 302 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:01.116922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e235-a04c-41db-b005-b776e5ce1f96 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.117211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e235-a04c-41db-b005-b776e5ce1f96 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.122330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e235-a04c-41db-b005-b776e5ce1f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.123373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 851/1706] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:01.125151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f8ba-e1c3-46c5-956c-f1cf551b12cc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:01.150213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f8ba-e1c3-46c5-956c-f1cf551b12cc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:01.165714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6e519-813e-4681-8653-733d08d80625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:01.166433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6e519-813e-4681-8653-733d08d80625 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.166886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6e519-813e-4681-8653-733d08d80625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.167009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6e519-813e-4681-8653-733d08d80625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.167629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6e519-813e-4681-8653-733d08d80625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:01.169363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6e519-813e-4681-8653-733d08d80625 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:01.190621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 852/1707] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:01.191286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6e519-813e-4681-8653-733d08d80625 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:01.192505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e5e6e235-a04c-41db-b005-b776e5ce1f96 None None] MFA Rules not processed for user `e4c7cd885cc24bf2934e4e9cecb50ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:01.198405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e5e6e235-a04c-41db-b005-b776e5ce1f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:01.217931 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6e519-813e-4681-8653-733d08d80625 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:01.219088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 856/1708] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:01.220123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6e235-a04c-41db-b005-b776e5ce1f96 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:01.236763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de79dc-b490-439b-a043-ba1a4e6249a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:01.241768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de79dc-b490-439b-a043-ba1a4e6249a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.241768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de79dc-b490-439b-a043-ba1a4e6249a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.241768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de79dc-b490-439b-a043-ba1a4e6249a9 admin admin] PATH_INFO: `/v3/projects/ab3653c349374e40b0645efad91d64a1/users/f5d53b48388848edb84e2bdd3b6a853b/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.241768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de79dc-b490-439b-a043-ba1a4e6249a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3653c349374e40b0645efad91d64a1, user_id=f5d53b48388848edb84e2bdd3b6a853b, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:01.243297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6e235-a04c-41db-b005-b776e5ce1f96 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:01.244210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de79dc-b490-439b-a043-ba1a4e6249a9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:01.259929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:01.260759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.261146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.261623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.262778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:01.264709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:01.279177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 857/1709] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:01.280429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:01.282842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 853/1710] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:01 2022] PUT /identity/v3/projects/ab3653c349374e40b0645efad91d64a1/users/f5d53b48388848edb84e2bdd3b6a853b/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:01.284926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de79dc-b490-439b-a043-ba1a4e6249a9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:01.293465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:01.441213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de79dc-b490-439b-a043-ba1a4e6249a9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:01.452592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f0b53-decb-4336-8f2d-743b7ab7779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:01.454144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0b53-decb-4336-8f2d-743b7ab7779d admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.454325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0b53-decb-4336-8f2d-743b7ab7779d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.455117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f0b53-decb-4336-8f2d-743b7ab7779d admin admin] PATH_INFO: `/v3/projects/043b6e89ccac4756b6c94da31be42196/users/91c21324bc3b406bbf9df8df25fb8bfa/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.466463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e7be9-f5f2-417e-b7aa-e8e35e844ae3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:01.480803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f0b53-decb-4336-8f2d-743b7ab7779d admin admin] RBAC: Authorizing `identity:create_grant(project_id=043b6e89ccac4756b6c94da31be42196, user_id=91c21324bc3b406bbf9df8df25fb8bfa, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:01.484910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f0b53-decb-4336-8f2d-743b7ab7779d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:01.548537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 854/1711] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:01 2022] PUT /identity/v3/projects/043b6e89ccac4756b6c94da31be42196/users/91c21324bc3b406bbf9df8df25fb8bfa/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:01.549847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f679a0-4258-4de3-902c-c8f4e7bc2637 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.549969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f679a0-4258-4de3-902c-c8f4e7bc2637 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.550305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f679a0-4258-4de3-902c-c8f4e7bc2637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.634408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f7f679a0-4258-4de3-902c-c8f4e7bc2637 None None] MFA Rules not processed for user `f5d53b48388848edb84e2bdd3b6a853b`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:01.642011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2669-d919-4eaf-8ad8-999bbdd811c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:01.649343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f7f679a0-4258-4de3-902c-c8f4e7bc2637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:01.650140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2669-d919-4eaf-8ad8-999bbdd811c6 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.650453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2669-d919-4eaf-8ad8-999bbdd811c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.650784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2669-d919-4eaf-8ad8-999bbdd811c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.814602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2669-d919-4eaf-8ad8-999bbdd811c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:01.814602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2669-d919-4eaf-8ad8-999bbdd811c6 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:01.830882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 858/1712] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:01.833101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0355-6081-4a39-ab79-8da9e27f7a40 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:01.833813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0355-6081-4a39-ab79-8da9e27f7a40 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:01.834270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0355-6081-4a39-ab79-8da9e27f7a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:01.849893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 855/1713] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:01.853812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f679a0-4258-4de3-902c-c8f4e7bc2637 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:01.857948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f7f679a0-4258-4de3-902c-c8f4e7bc2637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:01.903730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-59fe0355-6081-4a39-ab79-8da9e27f7a40 None None] MFA Rules not processed for user `ddc9556e5f7347948b6f872f1f854665`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:01.904688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-59fe0355-6081-4a39-ab79-8da9e27f7a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:02.107036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f679a0-4258-4de3-902c-c8f4e7bc2637 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:02.126300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:02.127008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:02.127290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:02.127566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] PATH_INFO: `/v3/users/7b62e44857f14410b29fcf12bbc75848` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:02.132047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b62e44857f14410b29fcf12bbc75848)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:02.135996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:02.165385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 859/1714] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:02.167770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56d54-5e68-480c-bed3-1c9eba836b42 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:02.167770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56d54-5e68-480c-bed3-1c9eba836b42 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:02.167770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56d54-5e68-480c-bed3-1c9eba836b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:02.228156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b9d56d54-5e68-480c-bed3-1c9eba836b42 None None] MFA Rules not processed for user `91c21324bc3b406bbf9df8df25fb8bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:02.239702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b9d56d54-5e68-480c-bed3-1c9eba836b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:02.401080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b62e44857f14410b29fcf12bbc75848'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:02.402439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b62e44857f14410b29fcf12bbc75848'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:02.425273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b62e44857f14410b29fcf12bbc75848'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:02.429243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 860/1715] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:02.435084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56d54-5e68-480c-bed3-1c9eba836b42 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:02.437490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b9d56d54-5e68-480c-bed3-1c9eba836b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:02.451140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b62e44857f14410b29fcf12bbc75848'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:02.455180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e769474f-7a5b-4a59-bda4-6252fd5f78d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b62e44857f14410b29fcf12bbc75848'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:02.512996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 856/1716] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:01 2022] DELETE /identity/v3/users/7b62e44857f14410b29fcf12bbc75848 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:02.514636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa9ac-ded0-4fa2-8629-38fa683120a6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:02.515078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa9ac-ded0-4fa2-8629-38fa683120a6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:02.515487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aa9ac-ded0-4fa2-8629-38fa683120a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:02.531518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56d54-5e68-480c-bed3-1c9eba836b42 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:02.586840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-903aa9ac-ded0-4fa2-8629-38fa683120a6 None None] MFA Rules not processed for user `ddc9556e5f7347948b6f872f1f854665`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:02.588494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-903aa9ac-ded0-4fa2-8629-38fa683120a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:02.643750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:02.657507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2b20e-891a-498d-bdee-dad3f8fb23ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:02.660461 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2b20e-891a-498d-bdee-dad3f8fb23ce service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:02.660620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2b20e-891a-498d-bdee-dad3f8fb23ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:02.660897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2b20e-891a-498d-bdee-dad3f8fb23ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:02.665721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1cb2b20e-891a-498d-bdee-dad3f8fb23ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:02.729241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 857/1717] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:02.730297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa9ac-ded0-4fa2-8629-38fa683120a6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:02.748066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-903aa9ac-ded0-4fa2-8629-38fa683120a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:02.826178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2b20e-891a-498d-bdee-dad3f8fb23ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:02.829435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2b20e-891a-498d-bdee-dad3f8fb23ce service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:02.854128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 861/1718] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:02.855590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71653627-5aa1-4ddd-9d0a-fbe39eac08f9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:02.855886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71653627-5aa1-4ddd-9d0a-fbe39eac08f9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:02.856167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71653627-5aa1-4ddd-9d0a-fbe39eac08f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:02.856463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aa9ac-ded0-4fa2-8629-38fa683120a6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:02.861791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f1cc2-cb23-4876-9491-6407ae262b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:02.862771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f1cc2-cb23-4876-9491-6407ae262b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:02.863367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f1cc2-cb23-4876-9491-6407ae262b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:02.863851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f1cc2-cb23-4876-9491-6407ae262b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:02.864718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f1cc2-cb23-4876-9491-6407ae262b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:02.867836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f1cc2-cb23-4876-9491-6407ae262b13 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:02.893313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-71653627-5aa1-4ddd-9d0a-fbe39eac08f9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:02.895455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-71653627-5aa1-4ddd-9d0a-fbe39eac08f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:02.905443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 862/1719] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:02.907326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71653627-5aa1-4ddd-9d0a-fbe39eac08f9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:02.918157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-71653627-5aa1-4ddd-9d0a-fbe39eac08f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:02.971806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 858/1720] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:02 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:02.971806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57b54-5efb-4ad6-a74c-438ce3c8a6ea None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:02.971806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57b54-5efb-4ad6-a74c-438ce3c8a6ea None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:02.971806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57b54-5efb-4ad6-a74c-438ce3c8a6ea None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:02.977769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 859/1721] 10.222.0.16 () {54 vars in 912 bytes} [Thu Sep 22 14:40:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:40:02.979091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b57b54-5efb-4ad6-a74c-438ce3c8a6ea None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:02.982886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-84b57b54-5efb-4ad6-a74c-438ce3c8a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:03.093694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71653627-5aa1-4ddd-9d0a-fbe39eac08f9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:03.120433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b57b54-5efb-4ad6-a74c-438ce3c8a6ea None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:03.130723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914471-ef92-4f16-896a-f76a82819501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:03.146536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914471-ef92-4f16-896a-f76a82819501 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:03.146536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914471-ef92-4f16-896a-f76a82819501 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:03.146536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914471-ef92-4f16-896a-f76a82819501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:03.255229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca23ecd-3ee1-4c68-85dc-4ec3186b8659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:03.256009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca23ecd-3ee1-4c68-85dc-4ec3186b8659 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:03.256283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca23ecd-3ee1-4c68-85dc-4ec3186b8659 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:03.256550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca23ecd-3ee1-4c68-85dc-4ec3186b8659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:03.259978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cca23ecd-3ee1-4c68-85dc-4ec3186b8659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:03.275877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e914471-ef92-4f16-896a-f76a82819501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:03.277324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e914471-ef92-4f16-896a-f76a82819501 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:03.296727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 860/1722] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:03.297487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914471-ef92-4f16-896a-f76a82819501 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:03.320820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e914471-ef92-4f16-896a-f76a82819501 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:03.334787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c57c-c279-41ed-92f9-de38d8148bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:03.335417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c57c-c279-41ed-92f9-de38d8148bec admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:03.335726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c57c-c279-41ed-92f9-de38d8148bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:03.335962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c57c-c279-41ed-92f9-de38d8148bec admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:03.336598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2c57c-c279-41ed-92f9-de38d8148bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:03.341596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2c57c-c279-41ed-92f9-de38d8148bec admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:03.400694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:03.449095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca23ecd-3ee1-4c68-85dc-4ec3186b8659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:03.451353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca23ecd-3ee1-4c68-85dc-4ec3186b8659 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:03.464770 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 863/1723] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:03.466446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa5492-d935-4673-b205-57adb7b0084a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:03.466938 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa5492-d935-4673-b205-57adb7b0084a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:03.467380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa5492-d935-4673-b205-57adb7b0084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:03.493267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 861/1724] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:03 2022] POST /identity/v3/users => generated 309 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:03.495488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c57c-c279-41ed-92f9-de38d8148bec admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:03.514545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c57c-c279-41ed-92f9-de38d8148bec admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:03.525788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec4a8-df15-4c2e-9120-fdc69982db85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:03.527320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec4a8-df15-4c2e-9120-fdc69982db85 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:03.527761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec4a8-df15-4c2e-9120-fdc69982db85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:03.528171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec4a8-df15-4c2e-9120-fdc69982db85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:03.528996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec4a8-df15-4c2e-9120-fdc69982db85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:03.531039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec4a8-df15-4c2e-9120-fdc69982db85 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:03.574127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 862/1725] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:03.580356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590cf0-58e4-4fcc-8a9e-0fcd82463af4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:03.580654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590cf0-58e4-4fcc-8a9e-0fcd82463af4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:03.594773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590cf0-58e4-4fcc-8a9e-0fcd82463af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:03.595951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-58aa5492-d935-4673-b205-57adb7b0084a None None] MFA Rules not processed for user `75252b7cba4943b2874983d1a83a9175`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:03.600674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-58aa5492-d935-4673-b205-57adb7b0084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:03.643062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 864/1726] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:40:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:03.649244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa5492-d935-4673-b205-57adb7b0084a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:03.664540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa5492-d935-4673-b205-57adb7b0084a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:03.681889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa595-5730-4277-977e-fc20d112ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:03.683320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa595-5730-4277-977e-fc20d112ab50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:03.685029 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa595-5730-4277-977e-fc20d112ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:03.685029 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa595-5730-4277-977e-fc20d112ab50 admin admin] PATH_INFO: `/v3/projects/5b16c8bffd3f4e61b09358a79ff873c2/users/bf279028786c41f7807ea08d78779a93/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:03.697549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ad590cf0-58e4-4fcc-8a9e-0fcd82463af4 None None] MFA Rules not processed for user `e31c29dd5cbb4ede8989904bfe4416ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:03.698757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ad590cf0-58e4-4fcc-8a9e-0fcd82463af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:03.741065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa595-5730-4277-977e-fc20d112ab50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b16c8bffd3f4e61b09358a79ff873c2, user_id=bf279028786c41f7807ea08d78779a93, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:03.747409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa595-5730-4277-977e-fc20d112ab50 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:03.861152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 863/1727] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:03.862333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590cf0-58e4-4fcc-8a9e-0fcd82463af4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:03.882465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590cf0-58e4-4fcc-8a9e-0fcd82463af4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:03.901036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 865/1728] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:03 2022] PUT /identity/v3/projects/5b16c8bffd3f4e61b09358a79ff873c2/users/bf279028786c41f7807ea08d78779a93/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:03.902649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa595-5730-4277-977e-fc20d112ab50 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:04.008248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ae62-d661-4543-9264-16767220b935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:04.010955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ae62-d661-4543-9264-16767220b935 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.010955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ae62-d661-4543-9264-16767220b935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.012590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ae62-d661-4543-9264-16767220b935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.025562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149ae62-d661-4543-9264-16767220b935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:04.030669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149ae62-d661-4543-9264-16767220b935 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:04.047539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa595-5730-4277-977e-fc20d112ab50 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:04.055253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 864/1729] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:04.056985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c516c0-5941-4ec3-9dd2-58bc836116b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:04.057745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c516c0-5941-4ec3-9dd2-58bc836116b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.058148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c516c0-5941-4ec3-9dd2-58bc836116b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.058544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c516c0-5941-4ec3-9dd2-58bc836116b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.059299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c516c0-5941-4ec3-9dd2-58bc836116b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:04.068392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c516c0-5941-4ec3-9dd2-58bc836116b0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:04.080380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 866/1730] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:04.085057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ae62-d661-4543-9264-16767220b935 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:04.102786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ae62-d661-4543-9264-16767220b935 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:04.117291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b082a10-7e1d-47a0-a7e4-d7098a9aa88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:04.117291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082a10-7e1d-47a0-a7e4-d7098a9aa88a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.117291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082a10-7e1d-47a0-a7e4-d7098a9aa88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.117291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b082a10-7e1d-47a0-a7e4-d7098a9aa88a admin admin] PATH_INFO: `/v3/projects/5b16c8bffd3f4e61b09358a79ff873c2/users/bf279028786c41f7807ea08d78779a93/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.117676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b082a10-7e1d-47a0-a7e4-d7098a9aa88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b16c8bffd3f4e61b09358a79ff873c2, user_id=bf279028786c41f7807ea08d78779a93, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:04.132608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b082a10-7e1d-47a0-a7e4-d7098a9aa88a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:04.183865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 865/1731] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:04 2022] PUT /identity/v3/projects/5b16c8bffd3f4e61b09358a79ff873c2/users/bf279028786c41f7807ea08d78779a93/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:04.188132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33db20-b744-4aa5-8b16-b74e00ce7975 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.193511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33db20-b744-4aa5-8b16-b74e00ce7975 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.193511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33db20-b744-4aa5-8b16-b74e00ce7975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.278576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56913e-2de4-4c6a-80b2-30fc3304a115 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.285419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56913e-2de4-4c6a-80b2-30fc3304a115 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.285419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56913e-2de4-4c6a-80b2-30fc3304a115 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.285419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 866/1732] 10.222.0.16 () {54 vars in 912 bytes} [Thu Sep 22 14:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:40:04.288816 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1e33db20-b744-4aa5-8b16-b74e00ce7975 None None] MFA Rules not processed for user `bf279028786c41f7807ea08d78779a93`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:04.290304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1e33db20-b744-4aa5-8b16-b74e00ce7975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:04.309010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe08eb-d77b-4b9d-8775-eccff6998fc5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.309010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe08eb-d77b-4b9d-8775-eccff6998fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.309423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe08eb-d77b-4b9d-8775-eccff6998fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.375415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9abe08eb-d77b-4b9d-8775-eccff6998fc5 None None] MFA Rules not processed for user `75252b7cba4943b2874983d1a83a9175`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:04.376683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9abe08eb-d77b-4b9d-8775-eccff6998fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:04.482486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 867/1733] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:04.482486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33db20-b744-4aa5-8b16-b74e00ce7975 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:04.484297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1e33db20-b744-4aa5-8b16-b74e00ce7975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:04.495858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 867/1734] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:40:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:04.504794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe08eb-d77b-4b9d-8775-eccff6998fc5 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:04.506504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9abe08eb-d77b-4b9d-8775-eccff6998fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:04.531448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe08eb-d77b-4b9d-8775-eccff6998fc5 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:04.544475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:04.544475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.545452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.546128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.567896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:04.571769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:04.619316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 868/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:04.620312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:04.621800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:04.699622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33db20-b744-4aa5-8b16-b74e00ce7975 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:04.715287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:04.716750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.717194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.717575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] PATH_INFO: `/v3/projects/36ad3c330e78459a9848bf063de7f685` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.719798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ad3c330e78459a9848bf063de7f685)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:04.723334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:04.756833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028963dc-0786-451f-9eb1-36aef00307ef service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:04.765531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:04.766492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:04.766492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:04.766754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:04.784870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:04.786398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:04.802727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 869/1736] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:04 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:04.866093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ad3c330e78459a9848bf063de7f685', 'request_id': 'req-848a5463-1b15-430c-9284-acee8bd5a0a8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:04.964710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ad3c330e78459a9848bf063de7f685', 'request_id': 'req-848a5463-1b15-430c-9284-acee8bd5a0a8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.004392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ad3c330e78459a9848bf063de7f685', 'request_id': 'req-848a5463-1b15-430c-9284-acee8bd5a0a8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.064720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] The token cache is being invalidate because project 36ad3c330e78459a9848bf063de7f685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:05.065925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:05.067920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.073592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.075487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:05.083703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 868/1737] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:04 2022] DELETE /identity/v3/projects/36ad3c330e78459a9848bf063de7f685 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:05.088328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:05.104564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:05.181126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:05.315558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500ee86-7002-4c90-984d-16094bf741da service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:05.365532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a5463-1b15-430c-9284-acee8bd5a0a8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:05.373860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:05.374658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:05.375239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:05.375579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] PATH_INFO: `/v3/users/149fd61424c947988b9172c20f38192d` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:05.376996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149fd61424c947988b9172c20f38192d)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:05.383333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:05.478167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:05.479086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:05.479517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:05.479938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:05.486587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:05.506197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:05.507993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:05.562007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 870/1738] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:05.562007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:05.562007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:05.576779 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62fdf7-a235-4c05-9034-82595396806a service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:05.595573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:05.596438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:05.603755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:05.604118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] PATH_INFO: `/v3/users/91c21324bc3b406bbf9df8df25fb8bfa` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:05.605481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c21324bc3b406bbf9df8df25fb8bfa)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:05.613423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:05.698519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149fd61424c947988b9172c20f38192d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.761009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149fd61424c947988b9172c20f38192d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.885592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149fd61424c947988b9172c20f38192d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.886818 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149fd61424c947988b9172c20f38192d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.900393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2d73e08a-a413-4e07-9c96-22c9155e41a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149fd61424c947988b9172c20f38192d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.937247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 869/1739] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:05 2022] DELETE /identity/v3/users/149fd61424c947988b9172c20f38192d => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:05.937247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7d356-bda4-4776-ac79-6aa126f02ebc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:05.937247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7d356-bda4-4776-ac79-6aa126f02ebc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:05.937247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7d356-bda4-4776-ac79-6aa126f02ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:05.948987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c21324bc3b406bbf9df8df25fb8bfa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.949958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c21324bc3b406bbf9df8df25fb8bfa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:05.982746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f8c7d356-bda4-4776-ac79-6aa126f02ebc None None] MFA Rules not processed for user `e4c7cd885cc24bf2934e4e9cecb50ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:05.985783 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f8c7d356-bda4-4776-ac79-6aa126f02ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:05.987815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c21324bc3b406bbf9df8df25fb8bfa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:06.022658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c21324bc3b406bbf9df8df25fb8bfa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:06.029518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c21324bc3b406bbf9df8df25fb8bfa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:06.085936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:06.136650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 870/1740] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:06.153410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 871/1741] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:05 2022] DELETE /identity/v3/users/91c21324bc3b406bbf9df8df25fb8bfa => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:06.158308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f9aee-12b3-41ad-9a31-4e8bbd833459 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:06.158738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f9aee-12b3-41ad-9a31-4e8bbd833459 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:06.159095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f9aee-12b3-41ad-9a31-4e8bbd833459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:06.250927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9a2f9aee-12b3-41ad-9a31-4e8bbd833459 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:06.257186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9a2f9aee-12b3-41ad-9a31-4e8bbd833459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:06.412928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 871/1742] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:06.443953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:06.448464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:06.678036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716877a-9ecc-4d8e-a594-b16022a42677 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:06.690871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:06.692784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:06.700143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:06.701130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:06.721336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:06.732346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:06.739374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 872/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:06.813147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:07.094156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f9aee-12b3-41ad-9a31-4e8bbd833459 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:07.096311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9a2f9aee-12b3-41ad-9a31-4e8bbd833459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:07.110182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f9aee-12b3-41ad-9a31-4e8bbd833459 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:07.116784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:07.117781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:07.118301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:07.118749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] PATH_INFO: `/v3/users/6dcf09738d5449e1a0d634755e46e60d` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:07.120130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcf09738d5449e1a0d634755e46e60d)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:07.122741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:07.235141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:07.236516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:07.271937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb413321-65c5-47a3-a6bb-c236bcaef67d service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:07.271937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:07.271937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:07.271937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:07.272419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] PATH_INFO: `/v3/projects/24dd00544d40435f9e9ec724b710cf3c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:07.272419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dd00544d40435f9e9ec724b710cf3c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:07.273600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:07.477366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcf09738d5449e1a0d634755e46e60d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.511792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcf09738d5449e1a0d634755e46e60d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.572768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dd00544d40435f9e9ec724b710cf3c', 'request_id': 'req-fd67b9c8-bd92-496c-a068-ed66abaa9eea'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.689896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcf09738d5449e1a0d634755e46e60d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.690705 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcf09738d5449e1a0d634755e46e60d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.723787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcf09738d5449e1a0d634755e46e60d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.735855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 872/1744] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:07 2022] DELETE /identity/v3/users/6dcf09738d5449e1a0d634755e46e60d => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:07.737317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:07.740714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:07.810528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dd00544d40435f9e9ec724b710cf3c', 'request_id': 'req-fd67b9c8-bd92-496c-a068-ed66abaa9eea'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.823429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dd00544d40435f9e9ec724b710cf3c', 'request_id': 'req-fd67b9c8-bd92-496c-a068-ed66abaa9eea'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.844229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] The token cache is being invalidate because project 24dd00544d40435f9e9ec724b710cf3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:07.844775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.846247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fd67b9c8-bd92-496c-a068-ed66abaa9eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:07.862044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 873/1745] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:07 2022] DELETE /identity/v3/projects/24dd00544d40435f9e9ec724b710cf3c => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:07.864479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140d796-a225-476f-95b1-bfa8345c8089 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:07.869947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140d796-a225-476f-95b1-bfa8345c8089 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:07.870482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140d796-a225-476f-95b1-bfa8345c8089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:07.895125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb211a4e-f6e1-4b44-9f9e-f8013ab2a7e9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:07.907218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:07.907862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:07.908146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:07.908416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:07.913708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d140d796-a225-476f-95b1-bfa8345c8089 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:07.914584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:07.915974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d140d796-a225-476f-95b1-bfa8345c8089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:08.031491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:08.032630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:08.047308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 874/1747] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:08.049488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 873/1746] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:08.057129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2381-4031-4a11-9859-6d888cf43c4e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:08.058757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2381-4031-4a11-9859-6d888cf43c4e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:08.059303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2381-4031-4a11-9859-6d888cf43c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:08.063431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:08.075431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:08.087704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0b8e2381-4031-4a11-9859-6d888cf43c4e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:08.089336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0b8e2381-4031-4a11-9859-6d888cf43c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:08.107686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 875/1748] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:08.116969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3b4e7-f6bc-48c4-8e2c-ed63f8f688ba None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:08.117558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3b4e7-f6bc-48c4-8e2c-ed63f8f688ba None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:08.118022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3b4e7-f6bc-48c4-8e2c-ed63f8f688ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:08.147482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7fb3b4e7-f6bc-48c4-8e2c-ed63f8f688ba None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:08.150289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7fb3b4e7-f6bc-48c4-8e2c-ed63f8f688ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:08.161339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 876/1749] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:08.162538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3b4e7-f6bc-48c4-8e2c-ed63f8f688ba None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:08.179870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7fb3b4e7-f6bc-48c4-8e2c-ed63f8f688ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:08.211238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3b4e7-f6bc-48c4-8e2c-ed63f8f688ba None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:08.224667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:08.233564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:08.234140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:08.234763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] PATH_INFO: `/v3/projects/043b6e89ccac4756b6c94da31be42196` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:08.236306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043b6e89ccac4756b6c94da31be42196)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:08.239462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4e36-d2be-46f8-b9c9-1e8e215e5a07 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:08.240733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:08.256658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70769c9-964d-4423-a4b9-d50e7de92fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:08.257299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70769c9-964d-4423-a4b9-d50e7de92fce service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:08.257576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70769c9-964d-4423-a4b9-d50e7de92fce service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:08.258052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70769c9-964d-4423-a4b9-d50e7de92fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:08.282225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70769c9-964d-4423-a4b9-d50e7de92fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:08.283783 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70769c9-964d-4423-a4b9-d50e7de92fce service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:08.307766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 874/1750] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:08.308708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70769c9-964d-4423-a4b9-d50e7de92fce service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:08.327033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70769c9-964d-4423-a4b9-d50e7de92fce service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:08.339902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:08.340154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:08.340686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:08.342271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:08.343120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:08.345776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:08.350282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:08.353227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:08.388595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 875/1751] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:08.425611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:08.454843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd9dce-d717-4d70-922f-e284b91dc62c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:08.495612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043b6e89ccac4756b6c94da31be42196', 'request_id': 'req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:08.562782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:08.563473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:08.563811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:08.564138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:08.565175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:08.568642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:08.620897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043b6e89ccac4756b6c94da31be42196', 'request_id': 'req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:08.629516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043b6e89ccac4756b6c94da31be42196', 'request_id': 'req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:08.655815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] The token cache is being invalidate because project 043b6e89ccac4756b6c94da31be42196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:08.656235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:08.658450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:08.662630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 877/1752] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:08 2022] DELETE /identity/v3/projects/043b6e89ccac4756b6c94da31be42196 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:08.666909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:08.669065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:08.734097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245d0bb-c8b2-4305-b0ee-5c3f4399b418 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:08.755194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:08.756140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:08.758340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:08.758904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] PATH_INFO: `/v3/users/bf279028786c41f7807ea08d78779a93` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:08.761303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf279028786c41f7807ea08d78779a93)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:08.764584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:08.766984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 876/1753] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:08 2022] POST /identity/v3/projects => generated 379 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:08.767696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:08.772200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:09.037271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb16697-7e1b-4f37-b313-dfff1ac33af1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:09.043292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:09.044510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:09.044991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:09.045821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:09.046862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:09.049232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:09.311323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 877/1754] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:08 2022] POST /identity/v3/users => generated 290 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:09.312956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:09.316310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:09.317332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf279028786c41f7807ea08d78779a93'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.318353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf279028786c41f7807ea08d78779a93'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.329517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf279028786c41f7807ea08d78779a93'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.361300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6ec45-b471-4591-8835-f222069e9a0a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:09.371860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf279028786c41f7807ea08d78779a93'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.383291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf279028786c41f7807ea08d78779a93'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.384736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:09.388028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:09.388765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:09.389518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] PATH_INFO: `/v3/projects/983b28afc2f5403a9fde90ddd7e45595` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:09.393129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=983b28afc2f5403a9fde90ddd7e45595)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:09.396562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:09.547647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 878/1755] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:08 2022] DELETE /identity/v3/users/bf279028786c41f7807ea08d78779a93 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:09.550248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:09.563414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:09.636758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983b28afc2f5403a9fde90ddd7e45595', 'request_id': 'req-3b86eae6-648e-4c17-a678-75723ff00ffc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.664132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fff23c-a42f-443b-9b84-b5ef361e1fb0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:09.752291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33105f8b-493c-4f1b-8c58-82cfe0fc25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:09.752970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105f8b-493c-4f1b-8c58-82cfe0fc25fd admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:09.753670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105f8b-493c-4f1b-8c58-82cfe0fc25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:09.754123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105f8b-493c-4f1b-8c58-82cfe0fc25fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:09.755203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33105f8b-493c-4f1b-8c58-82cfe0fc25fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:09.757236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33105f8b-493c-4f1b-8c58-82cfe0fc25fd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:09.773934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 879/1756] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:09.777932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33105f8b-493c-4f1b-8c58-82cfe0fc25fd admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:09.795211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33105f8b-493c-4f1b-8c58-82cfe0fc25fd admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:09.798956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc27a-fb6d-48b7-85c7-96e5b3d6e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:09.799566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc27a-fb6d-48b7-85c7-96e5b3d6e7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:09.799863 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc27a-fb6d-48b7-85c7-96e5b3d6e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:09.800133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc27a-fb6d-48b7-85c7-96e5b3d6e7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:09.800804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fc27a-fb6d-48b7-85c7-96e5b3d6e7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:09.802464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fc27a-fb6d-48b7-85c7-96e5b3d6e7fa admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:09.819104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 880/1757] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:09.822398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc27a-fb6d-48b7-85c7-96e5b3d6e7fa admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:09.838845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc27a-fb6d-48b7-85c7-96e5b3d6e7fa admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:09.844202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c629dfc-96c9-46bf-ad15-c66233fda2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:09.845072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c629dfc-96c9-46bf-ad15-c66233fda2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:09.846321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c629dfc-96c9-46bf-ad15-c66233fda2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:09.846612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c629dfc-96c9-46bf-ad15-c66233fda2aa admin admin] PATH_INFO: `/v3/projects/8d139aa5dbbf4f14af31ccdd7e199772/users/490f0a45099049d0913405a0e3ed2852/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:09.850106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983b28afc2f5403a9fde90ddd7e45595', 'request_id': 'req-3b86eae6-648e-4c17-a678-75723ff00ffc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.857802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983b28afc2f5403a9fde90ddd7e45595', 'request_id': 'req-3b86eae6-648e-4c17-a678-75723ff00ffc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.873436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c629dfc-96c9-46bf-ad15-c66233fda2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d139aa5dbbf4f14af31ccdd7e199772, user_id=490f0a45099049d0913405a0e3ed2852, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:09.877634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c629dfc-96c9-46bf-ad15-c66233fda2aa admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:09.883197 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] The token cache is being invalidate because project 983b28afc2f5403a9fde90ddd7e45595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:09.883699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.884516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:09.900590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 878/1758] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:09 2022] DELETE /identity/v3/projects/983b28afc2f5403a9fde90ddd7e45595 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:09.905447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:09.909321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:09.942390 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86eae6-648e-4c17-a678-75723ff00ffc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:09.954022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:09.954806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:09.955096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:09.958240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] PATH_INFO: `/v3/users/e30f035ed40d446b86d63cacf68dd9cf` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:09.962981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30f035ed40d446b86d63cacf68dd9cf)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:09.964907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:10.093591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:10.102588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 881/1759] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:09 2022] PUT /identity/v3/projects/8d139aa5dbbf4f14af31ccdd7e199772/users/490f0a45099049d0913405a0e3ed2852/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:10.116365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ad5e5-d7ff-4fd9-8d2c-250adb266f9f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:10.116763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ad5e5-d7ff-4fd9-8d2c-250adb266f9f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:10.120341 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ad5e5-d7ff-4fd9-8d2c-250adb266f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:10.181941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-628ad5e5-d7ff-4fd9-8d2c-250adb266f9f None None] MFA Rules not processed for user `490f0a45099049d0913405a0e3ed2852`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:10.184098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-628ad5e5-d7ff-4fd9-8d2c-250adb266f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:10.241098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30f035ed40d446b86d63cacf68dd9cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:10.274963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30f035ed40d446b86d63cacf68dd9cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:10.342948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 882/1760] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:10.348993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ad5e5-d7ff-4fd9-8d2c-250adb266f9f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:10.351049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-628ad5e5-d7ff-4fd9-8d2c-250adb266f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:10.411363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30f035ed40d446b86d63cacf68dd9cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:10.412052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30f035ed40d446b86d63cacf68dd9cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:10.421002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30f035ed40d446b86d63cacf68dd9cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:10.456370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 879/1761] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:09 2022] DELETE /identity/v3/users/e30f035ed40d446b86d63cacf68dd9cf => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:10.505734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ad5e5-d7ff-4fd9-8d2c-250adb266f9f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:10.597401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:10.598180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:10.598534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:10.598895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:10.599603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:10.602582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:10.737750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:10.742184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:10.762299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 883/1762] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:10 2022] POST /identity/v3/projects => generated 381 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:10.767892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:10.773124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:10.824399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f7021-1491-4574-a7db-d3ceb7e08151 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:10.903364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c99a20-fc3e-4368-8805-8bd9baba3a87 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:10.916943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:10.917672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:10.921069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:10.921069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] PATH_INFO: `/v3/projects/5b16c8bffd3f4e61b09358a79ff873c2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:10.921069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b16c8bffd3f4e61b09358a79ff873c2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:10.921971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:10.924653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b4aa3-4854-4259-b2be-caf95ab2812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:10.925512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4aa3-4854-4259-b2be-caf95ab2812e admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:10.927555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4aa3-4854-4259-b2be-caf95ab2812e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:10.927887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b4aa3-4854-4259-b2be-caf95ab2812e admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:10.928629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b4aa3-4854-4259-b2be-caf95ab2812e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:10.931036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b4aa3-4854-4259-b2be-caf95ab2812e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:11.078852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:11.090022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 884/1763] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:10 2022] POST /identity/v3/users => generated 297 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:11.090820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b4aa3-4854-4259-b2be-caf95ab2812e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:11.119064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b4aa3-4854-4259-b2be-caf95ab2812e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:11.121811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b16c8bffd3f4e61b09358a79ff873c2', 'request_id': 'req-b107dfe3-c759-44d7-973f-6760c30e8a6c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:11.198317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b10c7-f2c6-44ad-ae01-e1dfdc229956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:11.199087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b10c7-f2c6-44ad-ae01-e1dfdc229956 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.199439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b10c7-f2c6-44ad-ae01-e1dfdc229956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.199783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b10c7-f2c6-44ad-ae01-e1dfdc229956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.200546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b10c7-f2c6-44ad-ae01-e1dfdc229956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:11.202199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b10c7-f2c6-44ad-ae01-e1dfdc229956 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:11.235639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 885/1764] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:11.239046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b10c7-f2c6-44ad-ae01-e1dfdc229956 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:11.264350 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b10c7-f2c6-44ad-ae01-e1dfdc229956 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:11.275364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:11.276180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.276471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.276755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] PATH_INFO: `/v3/projects/7614c213571c481a87647b01df81f448/users/4a467901ca9a4e4888c439f365bd8665/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.289307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b16c8bffd3f4e61b09358a79ff873c2', 'request_id': 'req-b107dfe3-c759-44d7-973f-6760c30e8a6c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:11.298412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b16c8bffd3f4e61b09358a79ff873c2', 'request_id': 'req-b107dfe3-c759-44d7-973f-6760c30e8a6c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:11.312467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7614c213571c481a87647b01df81f448, user_id=4a467901ca9a4e4888c439f365bd8665, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:11.315851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] The token cache is being invalidate because project 5b16c8bffd3f4e61b09358a79ff873c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:11.316778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:11.317592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:11.318187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b107dfe3-c759-44d7-973f-6760c30e8a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:11.320076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 880/1765] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:10 2022] DELETE /identity/v3/projects/5b16c8bffd3f4e61b09358a79ff873c2 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:11.326126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773472-1231-47f6-9508-85a4de44b764 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.328345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773472-1231-47f6-9508-85a4de44b764 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.328345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773472-1231-47f6-9508-85a4de44b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.349112 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-24773472-1231-47f6-9508-85a4de44b764 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:11.350528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-24773472-1231-47f6-9508-85a4de44b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:11.364106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 881/1766] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:11.374510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98631-b6f7-4207-8bc2-42fae6334a54 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.374761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98631-b6f7-4207-8bc2-42fae6334a54 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.376529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e98631-b6f7-4207-8bc2-42fae6334a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.419871 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-45e98631-b6f7-4207-8bc2-42fae6334a54 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:11.422884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-45e98631-b6f7-4207-8bc2-42fae6334a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:11.443587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 882/1767] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:11.448054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e98631-b6f7-4207-8bc2-42fae6334a54 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:11.464408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 886/1768] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:11 2022] PUT /identity/v3/projects/7614c213571c481a87647b01df81f448/users/4a467901ca9a4e4888c439f365bd8665/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:11.467158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e98631-b6f7-4207-8bc2-42fae6334a54 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:11.467896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:11.469594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:11.595836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:11.596822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.597128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.598165 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.598918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:11.599245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:11.600998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:11.610958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f75ff7-9018-4402-8a59-57fe193ca80a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:11.618761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3791c7-44dc-4a06-8b69-535f0c1ffef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:11.620931 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3791c7-44dc-4a06-8b69-535f0c1ffef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.622194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3791c7-44dc-4a06-8b69-535f0c1ffef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.622825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3791c7-44dc-4a06-8b69-535f0c1ffef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.624118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3791c7-44dc-4a06-8b69-535f0c1ffef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:11.631665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3791c7-44dc-4a06-8b69-535f0c1ffef8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:11.641311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 883/1769] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:40:11.646595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 887/1770] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:40:11.650471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:11.650618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3791c7-44dc-4a06-8b69-535f0c1ffef8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:11.661939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3791c7-44dc-4a06-8b69-535f0c1ffef8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:11.665592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0e10f-7c6f-4186-a16a-0c3bfa8faa1c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:11.667155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea876a93-3f21-4b89-942f-d8a33a43fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:11.672686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876a93-3f21-4b89-942f-d8a33a43fc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.673056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876a93-3f21-4b89-942f-d8a33a43fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.673406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876a93-3f21-4b89-942f-d8a33a43fc3a admin admin] PATH_INFO: `/v3/projects/7614c213571c481a87647b01df81f448/users/4a467901ca9a4e4888c439f365bd8665/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.676328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea876a93-3f21-4b89-942f-d8a33a43fc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7614c213571c481a87647b01df81f448, user_id=4a467901ca9a4e4888c439f365bd8665, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:11.678346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:11.679429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.679429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.679611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea876a93-3f21-4b89-942f-d8a33a43fc3a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:11.679691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.680353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:11.682314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:11.693682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 888/1771] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:11 2022] PUT /identity/v3/projects/7614c213571c481a87647b01df81f448/users/4a467901ca9a4e4888c439f365bd8665/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:11.711066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf0a48-cbb1-4813-9113-9b0b5ead97dc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.711411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf0a48-cbb1-4813-9113-9b0b5ead97dc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.711693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf0a48-cbb1-4813-9113-9b0b5ead97dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.760063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a4cf0a48-cbb1-4813-9113-9b0b5ead97dc None None] MFA Rules not processed for user `4a467901ca9a4e4888c439f365bd8665`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:11.761834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a4cf0a48-cbb1-4813-9113-9b0b5ead97dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:11.829394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 884/1772] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:11 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:11.830328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:11.834924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:11.872009 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 889/1773] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:11.872876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf0a48-cbb1-4813-9113-9b0b5ead97dc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:11.961834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097154b-de07-42e8-9a39-88669577967d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:11.967303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:11.974218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf0a48-cbb1-4813-9113-9b0b5ead97dc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:11.977377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.977666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.977945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] PATH_INFO: `/v3/projects/a6cbd888a8a2451faf5a3d541172150c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.980060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:11.980861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:11.981149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:11.981427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:11.982266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:11.982780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6cbd888a8a2451faf5a3d541172150c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:11.984724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:12.001057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:12.120126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 890/1774] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:11 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:12.121154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:12.123383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:12.163439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cbd888a8a2451faf5a3d541172150c', 'request_id': 'req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:12.201008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85839a8-5298-4907-9ba9-ad0b987c8a47 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:12.216427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:12.272442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cbd888a8a2451faf5a3d541172150c', 'request_id': 'req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:12.282535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cbd888a8a2451faf5a3d541172150c', 'request_id': 'req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:12.289279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:12.302560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] The token cache is being invalidate because project a6cbd888a8a2451faf5a3d541172150c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:12.302937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:12.304285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:12.311621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 885/1775] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:11 2022] DELETE /identity/v3/projects/a6cbd888a8a2451faf5a3d541172150c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:12.313169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:12.318822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:12.342746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d885a-9603-4437-8685-6dd3c346d2f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:12.343445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d885a-9603-4437-8685-6dd3c346d2f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.343810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d885a-9603-4437-8685-6dd3c346d2f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:12.344167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d885a-9603-4437-8685-6dd3c346d2f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:12.353247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-028d885a-9603-4437-8685-6dd3c346d2f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:12.445007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813cd16-3260-44a9-bf8e-fd2c6fffaf77 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:12.456110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb7471-3148-4932-8857-68b172d09cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:12.458099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb7471-3148-4932-8857-68b172d09cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.458857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb7471-3148-4932-8857-68b172d09cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:12.459572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb7471-3148-4932-8857-68b172d09cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:12.460946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb7471-3148-4932-8857-68b172d09cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:12.461112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d885a-9603-4437-8685-6dd3c346d2f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:12.463243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d885a-9603-4437-8685-6dd3c346d2f0 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:12.465369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb7471-3148-4932-8857-68b172d09cb6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:12.488504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 891/1776] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:12.488504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4205db8-55c8-4cfa-a0d2-fea66ffe0b47 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.488504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4205db8-55c8-4cfa-a0d2-fea66ffe0b47 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:12.488504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4205db8-55c8-4cfa-a0d2-fea66ffe0b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:12.498891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 886/1777] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:12.500769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb7471-3148-4932-8857-68b172d09cb6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:12.522531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb7471-3148-4932-8857-68b172d09cb6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:12.523509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e4205db8-55c8-4cfa-a0d2-fea66ffe0b47 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:12.524770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e4205db8-55c8-4cfa-a0d2-fea66ffe0b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:12.533335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f622-13ef-4a3e-9cc7-cce765c592bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:12.534844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f622-13ef-4a3e-9cc7-cce765c592bc admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.535741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f622-13ef-4a3e-9cc7-cce765c592bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:12.536581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f622-13ef-4a3e-9cc7-cce765c592bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:12.537930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f622-13ef-4a3e-9cc7-cce765c592bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:12.541437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f622-13ef-4a3e-9cc7-cce765c592bc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:12.545730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 892/1778] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:12.555003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d386c1-1bd7-4377-9641-37b478355c61 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.555390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d386c1-1bd7-4377-9641-37b478355c61 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:12.555549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d386c1-1bd7-4377-9641-37b478355c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:12.578121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 887/1779] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:12.582254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f622-13ef-4a3e-9cc7-cce765c592bc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:12.598991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-45d386c1-1bd7-4377-9641-37b478355c61 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:12.600851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-45d386c1-1bd7-4377-9641-37b478355c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:12.620014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f622-13ef-4a3e-9cc7-cce765c592bc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:12.630806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 893/1780] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:12.634027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957df018-7af7-4350-b7f7-569349157c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:12.634027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df018-7af7-4350-b7f7-569349157c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.634435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df018-7af7-4350-b7f7-569349157c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:12.635111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df018-7af7-4350-b7f7-569349157c97 admin admin] PATH_INFO: `/v3/projects/97bd8928189047b19675a9095ad261a0/users/1342b635abd8439a8ba0050aa9bf5910/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:12.635730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d386c1-1bd7-4377-9641-37b478355c61 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:12.666815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957df018-7af7-4350-b7f7-569349157c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bd8928189047b19675a9095ad261a0, user_id=1342b635abd8439a8ba0050aa9bf5910, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:12.674886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957df018-7af7-4350-b7f7-569349157c97 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:12.700282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d386c1-1bd7-4377-9641-37b478355c61 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:12.728233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:12.729483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.730044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:12.734922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:12.738634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:12.743155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:12.752123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:12.776122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 888/1781] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:12 2022] PUT /identity/v3/projects/97bd8928189047b19675a9095ad261a0/users/1342b635abd8439a8ba0050aa9bf5910/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:12.789745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03bc58-9c01-407b-858d-5c666a9b50b8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.790086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03bc58-9c01-407b-858d-5c666a9b50b8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:12.790327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03bc58-9c01-407b-858d-5c666a9b50b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:12.812732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 894/1782] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:12.815476 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:12.850955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80e8a1-c2c8-404f-bfad-59439cf6ea90 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:12.888131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2c03bc58-9c01-407b-858d-5c666a9b50b8 None None] MFA Rules not processed for user `1342b635abd8439a8ba0050aa9bf5910`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:12.888131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2c03bc58-9c01-407b-858d-5c666a9b50b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:12.996427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cc1f7-6b16-44f0-a0d3-bbffea15a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:12.998641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc1f7-6b16-44f0-a0d3-bbffea15a183 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:12.999497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc1f7-6b16-44f0-a0d3-bbffea15a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:13.007855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cc1f7-6b16-44f0-a0d3-bbffea15a183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:13.009035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cc1f7-6b16-44f0-a0d3-bbffea15a183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:13.011463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cc1f7-6b16-44f0-a0d3-bbffea15a183 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:13.050026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 889/1783] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:13.050026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6bd4a-4219-421c-b4e4-5d800d8a0e40 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:13.050026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6bd4a-4219-421c-b4e4-5d800d8a0e40 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:13.050026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6bd4a-4219-421c-b4e4-5d800d8a0e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:13.105359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a8f6bd4a-4219-421c-b4e4-5d800d8a0e40 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:13.107584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a8f6bd4a-4219-421c-b4e4-5d800d8a0e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:13.219100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 895/1784] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:12 2022] POST /identity/v3/projects => generated 377 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:13.220460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cc1f7-6b16-44f0-a0d3-bbffea15a183 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:13.232360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 890/1785] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:40:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:13.235515 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6bd4a-4219-421c-b4e4-5d800d8a0e40 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:13.258156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6bd4a-4219-421c-b4e4-5d800d8a0e40 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:13.345463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cc1f7-6b16-44f0-a0d3-bbffea15a183 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:13.351020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf706ab4-4e84-45c8-90f2-c011201fe7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:13.351958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971b4f-a554-4206-b9a4-4ec912897f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:13.352245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706ab4-4e84-45c8-90f2-c011201fe7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:13.352608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971b4f-a554-4206-b9a4-4ec912897f54 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:13.352882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971b4f-a554-4206-b9a4-4ec912897f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:13.353119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706ab4-4e84-45c8-90f2-c011201fe7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:13.353237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971b4f-a554-4206-b9a4-4ec912897f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:13.353692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf706ab4-4e84-45c8-90f2-c011201fe7fc admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:13.353791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971b4f-a554-4206-b9a4-4ec912897f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:13.354653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf706ab4-4e84-45c8-90f2-c011201fe7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:13.355854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971b4f-a554-4206-b9a4-4ec912897f54 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:13.357832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf706ab4-4e84-45c8-90f2-c011201fe7fc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:13.365191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:13.576215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 891/1786] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:13 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:13.580580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf706ab4-4e84-45c8-90f2-c011201fe7fc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:13.599064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 896/1787] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:13 2022] POST /identity/v3/projects => generated 369 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:13.601795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971b4f-a554-4206-b9a4-4ec912897f54 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:13.619522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf706ab4-4e84-45c8-90f2-c011201fe7fc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:13.731478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971b4f-a554-4206-b9a4-4ec912897f54 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:13.740655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be58b8-cb53-4516-b2b3-b674da2f9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:13.741412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be58b8-cb53-4516-b2b3-b674da2f9497 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:13.741758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be58b8-cb53-4516-b2b3-b674da2f9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:13.742136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be58b8-cb53-4516-b2b3-b674da2f9497 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:13.742868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be58b8-cb53-4516-b2b3-b674da2f9497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:13.745255 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be58b8-cb53-4516-b2b3-b674da2f9497 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:13.771536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:13.772245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:13.772525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:13.772869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:13.773533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:13.775351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:13.789471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 892/1788] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:40:13.794416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:13.796280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:13.912697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e20fa-f53c-4676-9bbe-a1c7767f6823 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:13.920046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10d12e-ca24-498f-a5e2-146c9c526c2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:13.920765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10d12e-ca24-498f-a5e2-146c9c526c2b service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:13.921235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10d12e-ca24-498f-a5e2-146c9c526c2b service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:13.921594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10d12e-ca24-498f-a5e2-146c9c526c2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:13.943760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 897/1789] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:13 2022] POST /identity/v3/users => generated 291 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:13.948519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be58b8-cb53-4516-b2b3-b674da2f9497 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:13.969182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be58b8-cb53-4516-b2b3-b674da2f9497 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:13.984338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e479a-96d5-44a8-8d74-2a2dca2e311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:13.985100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e479a-96d5-44a8-8d74-2a2dca2e311d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:13.985723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e479a-96d5-44a8-8d74-2a2dca2e311d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:13.986062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e479a-96d5-44a8-8d74-2a2dca2e311d admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:13.986673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e479a-96d5-44a8-8d74-2a2dca2e311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:13.989684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e479a-96d5-44a8-8d74-2a2dca2e311d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:14.044788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 898/1790] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:14.045314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf069-c7a9-4b77-ab10-a05699a11f0f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:14.045699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf069-c7a9-4b77-ab10-a05699a11f0f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:14.046292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cf069-c7a9-4b77-ab10-a05699a11f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:14.058134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10d12e-ca24-498f-a5e2-146c9c526c2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:14.060628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10d12e-ca24-498f-a5e2-146c9c526c2b service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:14.069933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 893/1791] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:40:14.070785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10d12e-ca24-498f-a5e2-146c9c526c2b service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:14.076870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-836cf069-c7a9-4b77-ab10-a05699a11f0f None None] MFA Rules not processed for user `75252b7cba4943b2874983d1a83a9175`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:14.084585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10d12e-ca24-498f-a5e2-146c9c526c2b service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:14.088374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-836cf069-c7a9-4b77-ab10-a05699a11f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:14.090352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83536a52-9611-42b8-a76a-fc7c4d297bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:14.092164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83536a52-9611-42b8-a76a-fc7c4d297bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:14.092462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83536a52-9611-42b8-a76a-fc7c4d297bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:14.092741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83536a52-9611-42b8-a76a-fc7c4d297bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:14.093621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83536a52-9611-42b8-a76a-fc7c4d297bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:14.095680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83536a52-9611-42b8-a76a-fc7c4d297bf5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:14.107785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 894/1792] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:14.112407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83536a52-9611-42b8-a76a-fc7c4d297bf5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:14.123778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83536a52-9611-42b8-a76a-fc7c4d297bf5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:14.132401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:14.134520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:14.146793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:14.146793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] PATH_INFO: `/v3/projects/b99562e2dd0b41418a7ee076299ca566/users/8d5f6f337cb2467bb111fd0f332fac9b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:14.188082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 899/1793] 10.222.0.60 () {58 vars in 1015 bytes} [Thu Sep 22 14:40:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:14.190360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cf069-c7a9-4b77-ab10-a05699a11f0f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:14.203337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99562e2dd0b41418a7ee076299ca566, user_id=8d5f6f337cb2467bb111fd0f332fac9b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:14.208821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:14.219410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cf069-c7a9-4b77-ab10-a05699a11f0f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:14.225225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6200c-cb0c-4742-8c27-a7fd7055ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:14.225907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6200c-cb0c-4742-8c27-a7fd7055ef94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:14.226276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6200c-cb0c-4742-8c27-a7fd7055ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:14.226560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6200c-cb0c-4742-8c27-a7fd7055ef94 admin admin] PATH_INFO: `/v3/projects/97d3a8a959754abfaf1ecfa3b9ffbb6d/users/f08f068fb5f648139dc9787678982797/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:14.258353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6200c-cb0c-4742-8c27-a7fd7055ef94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d3a8a959754abfaf1ecfa3b9ffbb6d, user_id=f08f068fb5f648139dc9787678982797, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:14.261890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6200c-cb0c-4742-8c27-a7fd7055ef94 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:14.565482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 895/1794] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:14 2022] PUT /identity/v3/projects/b99562e2dd0b41418a7ee076299ca566/users/8d5f6f337cb2467bb111fd0f332fac9b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:14.568971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:14.573530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:14.574571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 900/1795] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:14 2022] PUT /identity/v3/projects/97d3a8a959754abfaf1ecfa3b9ffbb6d/users/f08f068fb5f648139dc9787678982797/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:14.580179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693bf5-bd9c-43d6-a086-09059369742b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:14.583814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693bf5-bd9c-43d6-a086-09059369742b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:14.584209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e693bf5-bd9c-43d6-a086-09059369742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:14.726966 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3e693bf5-bd9c-43d6-a086-09059369742b None None] MFA Rules not processed for user `8d5f6f337cb2467bb111fd0f332fac9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:14.728257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3e693bf5-bd9c-43d6-a086-09059369742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:14.751106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532c4ca-0829-4946-a80c-2acd4b18e3f8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:14.870693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad76141-e639-410a-9a7e-a6012b1cd8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:14.871792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76141-e639-410a-9a7e-a6012b1cd8ed service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:14.873216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76141-e639-410a-9a7e-a6012b1cd8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:14.873922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad76141-e639-410a-9a7e-a6012b1cd8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:14.886544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 901/1796] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:14.904512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e693bf5-bd9c-43d6-a086-09059369742b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:14.932888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad76141-e639-410a-9a7e-a6012b1cd8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:14.937078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad76141-e639-410a-9a7e-a6012b1cd8ed service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:14.962397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 896/1797] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:14.963460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad76141-e639-410a-9a7e-a6012b1cd8ed service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:15.116602 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e693bf5-bd9c-43d6-a086-09059369742b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:15.121896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419ad0-778d-4f35-9835-10e1fc688c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:15.122582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419ad0-778d-4f35-9835-10e1fc688c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:15.123015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419ad0-778d-4f35-9835-10e1fc688c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:15.123186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b419ad0-778d-4f35-9835-10e1fc688c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:15.125106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419ad0-778d-4f35-9835-10e1fc688c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:15.142846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b419ad0-778d-4f35-9835-10e1fc688c09 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:15.235098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 902/1798] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:15.235322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419ad0-778d-4f35-9835-10e1fc688c09 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:15.249378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad76141-e639-410a-9a7e-a6012b1cd8ed service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:15.283071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb3d1-b560-4178-b6f1-dd0b364879a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:15.284537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b419ad0-778d-4f35-9835-10e1fc688c09 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:15.289646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb3d1-b560-4178-b6f1-dd0b364879a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:15.290261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb3d1-b560-4178-b6f1-dd0b364879a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:15.295008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb3d1-b560-4178-b6f1-dd0b364879a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:15.309847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbb3d1-b560-4178-b6f1-dd0b364879a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:15.309847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbb3d1-b560-4178-b6f1-dd0b364879a4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:15.310372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680cd97-3056-4df7-aed8-2d733ba290fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:15.310372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680cd97-3056-4df7-aed8-2d733ba290fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:15.310372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680cd97-3056-4df7-aed8-2d733ba290fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:15.310372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680cd97-3056-4df7-aed8-2d733ba290fb admin admin] PATH_INFO: `/v3/projects/97d3a8a959754abfaf1ecfa3b9ffbb6d/users/f08f068fb5f648139dc9787678982797/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:15.329896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680cd97-3056-4df7-aed8-2d733ba290fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d3a8a959754abfaf1ecfa3b9ffbb6d, user_id=f08f068fb5f648139dc9787678982797, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:15.351986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680cd97-3056-4df7-aed8-2d733ba290fb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:15.379753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 903/1799] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:15 2022] PUT /identity/v3/projects/97d3a8a959754abfaf1ecfa3b9ffbb6d/users/f08f068fb5f648139dc9787678982797/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:15.392323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6d9a3-cd3e-4ea8-9943-a2d1d8c43faf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:15.394004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6d9a3-cd3e-4ea8-9943-a2d1d8c43faf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:15.401732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6d9a3-cd3e-4ea8-9943-a2d1d8c43faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:15.500991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3ba6d9a3-cd3e-4ea8-9943-a2d1d8c43faf None None] MFA Rules not processed for user `f08f068fb5f648139dc9787678982797`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:15.503303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3ba6d9a3-cd3e-4ea8-9943-a2d1d8c43faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:15.615671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 897/1800] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:14 2022] POST /identity/v3/projects => generated 379 bytes in 653 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:15.615671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb3d1-b560-4178-b6f1-dd0b364879a4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:15.695713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 904/1801] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:15.697294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6d9a3-cd3e-4ea8-9943-a2d1d8c43faf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:15.749170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:15.834370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb3d1-b560-4178-b6f1-dd0b364879a4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:15.851855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a467901ca9a4e4888c439f365bd8665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7614c213571c481a87647b01df81f448', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:15.852986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:15.855787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:15.856176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:15.856785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:15.862574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:15.866739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:15.877575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6d9a3-cd3e-4ea8-9943-a2d1d8c43faf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:15.929599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 898/1802] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:15.930831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:15.938638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:16.052558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac155886-0e33-4103-a8a7-be094fc00e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:16.053319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155886-0e33-4103-a8a7-be094fc00e0a admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:16.053609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155886-0e33-4103-a8a7-be094fc00e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:16.053884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac155886-0e33-4103-a8a7-be094fc00e0a admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:16.054645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac155886-0e33-4103-a8a7-be094fc00e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:16.056740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac155886-0e33-4103-a8a7-be094fc00e0a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:16.083740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2350e5-759d-45f0-a206-b0a502c8ac42 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:16.098387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b46570-0653-430f-a92e-894102f91126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:16.099501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46570-0653-430f-a92e-894102f91126 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:16.100097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46570-0653-430f-a92e-894102f91126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:16.100479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b46570-0653-430f-a92e-894102f91126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:16.240857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b46570-0653-430f-a92e-894102f91126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:16.242782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b46570-0653-430f-a92e-894102f91126 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:16.257000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 899/1803] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:16.270918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b46570-0653-430f-a92e-894102f91126 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:16.298418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b46570-0653-430f-a92e-894102f91126 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:16.310304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3179e-b248-41a9-86ef-7e0f31236323 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a467901ca9a4e4888c439f365bd8665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7614c213571c481a87647b01df81f448', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:16.312216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3179e-b248-41a9-86ef-7e0f31236323 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:16.312849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3179e-b248-41a9-86ef-7e0f31236323 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:16.313397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3179e-b248-41a9-86ef-7e0f31236323 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:16.314523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3179e-b248-41a9-86ef-7e0f31236323 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:16.318023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3179e-b248-41a9-86ef-7e0f31236323 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:16.364806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 905/1804] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:15 2022] POST /identity/v3/users => generated 296 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:16.366356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac155886-0e33-4103-a8a7-be094fc00e0a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:16.476992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac155886-0e33-4103-a8a7-be094fc00e0a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:16.495142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d937b67-8932-43e3-b864-cbc2a1cc984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:16.495362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d937b67-8932-43e3-b864-cbc2a1cc984c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:16.495740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d937b67-8932-43e3-b864-cbc2a1cc984c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:16.496152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d937b67-8932-43e3-b864-cbc2a1cc984c admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:16.497025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d937b67-8932-43e3-b864-cbc2a1cc984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:16.501384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d937b67-8932-43e3-b864-cbc2a1cc984c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:16.531716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 900/1805] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:16 2022] POST /identity/v3/projects => generated 354 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:16.536075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3179e-b248-41a9-86ef-7e0f31236323 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:16.548989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 906/1806] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:16.553539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d937b67-8932-43e3-b864-cbc2a1cc984c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:16.596667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d937b67-8932-43e3-b864-cbc2a1cc984c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:16.680746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3179e-b248-41a9-86ef-7e0f31236323 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:16.687859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a467901ca9a4e4888c439f365bd8665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7614c213571c481a87647b01df81f448', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:16.688751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:16.689200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:16.689631 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:16.690687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:16.691662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:16.693747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:16.731567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 901/1807] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:16.747734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77692f4-485b-4e98-8875-7957a3ff8441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:16.748695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77692f4-485b-4e98-8875-7957a3ff8441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:16.749189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77692f4-485b-4e98-8875-7957a3ff8441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:16.749789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77692f4-485b-4e98-8875-7957a3ff8441 admin admin] PATH_INFO: `/v3/projects/e960bd6deb844597bca894ab51267e94/users/de92bb2f4bb54289ab5e3d32b1da676a/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:16.809010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77692f4-485b-4e98-8875-7957a3ff8441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e960bd6deb844597bca894ab51267e94, user_id=de92bb2f4bb54289ab5e3d32b1da676a, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:16.813628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77692f4-485b-4e98-8875-7957a3ff8441 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:16.853819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:16.867888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac457299-93db-4ff4-9738-3abbcc70c5cd tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:16.877671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a467901ca9a4e4888c439f365bd8665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7614c213571c481a87647b01df81f448', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:16.879174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:16.879629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:16.880209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] PATH_INFO: `/v3/projects/94e6a470e8814f459b07fd4a09d0e5e1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:16.881678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94e6a470e8814f459b07fd4a09d0e5e1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:16.887328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:16.917436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 907/1808] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:16 2022] PUT /identity/v3/projects/e960bd6deb844597bca894ab51267e94/users/de92bb2f4bb54289ab5e3d32b1da676a/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:16.921324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77692f4-485b-4e98-8875-7957a3ff8441 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:17.035381 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77692f4-485b-4e98-8875-7957a3ff8441 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:17.042571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ec81-63ca-4e1b-989a-c252ebce00f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:17.043127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ec81-63ca-4e1b-989a-c252ebce00f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:17.043414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ec81-63ca-4e1b-989a-c252ebce00f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:17.043747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10ec81-63ca-4e1b-989a-c252ebce00f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:17.044544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10ec81-63ca-4e1b-989a-c252ebce00f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:17.046343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10ec81-63ca-4e1b-989a-c252ebce00f4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:17.061524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:17.065680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 908/1809] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:40:17.071964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ec81-63ca-4e1b-989a-c252ebce00f4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:17.084907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10ec81-63ca-4e1b-989a-c252ebce00f4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:17.094695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d702f7-8b05-4b77-b971-65b560bce60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:17.096781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d702f7-8b05-4b77-b971-65b560bce60c admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:17.097480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d702f7-8b05-4b77-b971-65b560bce60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:17.098166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d702f7-8b05-4b77-b971-65b560bce60c admin admin] PATH_INFO: `/v3/projects/e960bd6deb844597bca894ab51267e94/users/de92bb2f4bb54289ab5e3d32b1da676a/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:17.101840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d702f7-8b05-4b77-b971-65b560bce60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e960bd6deb844597bca894ab51267e94, user_id=de92bb2f4bb54289ab5e3d32b1da676a, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:17.124764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d702f7-8b05-4b77-b971-65b560bce60c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:17.152234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e6a470e8814f459b07fd4a09d0e5e1', 'request_id': 'req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:17.161157 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 909/1810] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:17 2022] PUT /identity/v3/projects/e960bd6deb844597bca894ab51267e94/users/de92bb2f4bb54289ab5e3d32b1da676a/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:17.185078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9731d7-f226-4726-9eb4-25990b789ad6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:17.191569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9731d7-f226-4726-9eb4-25990b789ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:17.191569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9731d7-f226-4726-9eb4-25990b789ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:17.242355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-cd9731d7-f226-4726-9eb4-25990b789ad6 None None] MFA Rules not processed for user `de92bb2f4bb54289ab5e3d32b1da676a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:17.243967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cd9731d7-f226-4726-9eb4-25990b789ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:17.272214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e6a470e8814f459b07fd4a09d0e5e1', 'request_id': 'req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:17.294021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e6a470e8814f459b07fd4a09d0e5e1', 'request_id': 'req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:17.330651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] The token cache is being invalidate because project 94e6a470e8814f459b07fd4a09d0e5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:17.331090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:17.333723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:17.336502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 902/1811] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:16 2022] DELETE /identity/v3/projects/94e6a470e8814f459b07fd4a09d0e5e1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:17.366377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 910/1812] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:17.730619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:17.733512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:17.863930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcbca2-21ea-4a1f-9b6f-7d629bb56f47 tempest-VolumeQuotaClassesTest-1044889881 tempest-VolumeQuotaClassesTest-1044889881-project-admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:18.092260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3df99-864d-44d7-a819-caba5e6f36d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:18.092260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3df99-864d-44d7-a819-caba5e6f36d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:18.092260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3df99-864d-44d7-a819-caba5e6f36d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:18.092260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3df99-864d-44d7-a819-caba5e6f36d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:18.092819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-84a3df99-864d-44d7-a819-caba5e6f36d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:18.203207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3df99-864d-44d7-a819-caba5e6f36d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:18.208190 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3df99-864d-44d7-a819-caba5e6f36d8 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:18.237063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 903/1813] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:18.482971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693600db-ce6f-4ac1-957f-f8fcb27fe6cc None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:18.483670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693600db-ce6f-4ac1-957f-f8fcb27fe6cc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:18.483670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693600db-ce6f-4ac1-957f-f8fcb27fe6cc None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:18.491486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b11e7-f1aa-4470-952b-3ccc533e0bb9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:18.491901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b11e7-f1aa-4470-952b-3ccc533e0bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:18.492337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b11e7-f1aa-4470-952b-3ccc533e0bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:18.494358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 911/1814] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:40:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:40:18.537755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-409b11e7-f1aa-4470-952b-3ccc533e0bb9 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:18.705684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-409b11e7-f1aa-4470-952b-3ccc533e0bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:18.705684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 904/1815] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:18.782891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693600db-ce6f-4ac1-957f-f8fcb27fe6cc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:18.785473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-693600db-ce6f-4ac1-957f-f8fcb27fe6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:18.827713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693600db-ce6f-4ac1-957f-f8fcb27fe6cc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:18.874971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d6b85-600d-4e4c-ab4d-8cf0cf047d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:18.879052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6b85-600d-4e4c-ab4d-8cf0cf047d85 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:18.879381 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6b85-600d-4e4c-ab4d-8cf0cf047d85 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:18.880848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6b85-600d-4e4c-ab4d-8cf0cf047d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:18.906149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d6b85-600d-4e4c-ab4d-8cf0cf047d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:18.908159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d6b85-600d-4e4c-ab4d-8cf0cf047d85 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:18.943866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 912/1816] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:19.133593 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:19.209006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1c09-90cb-4bbd-9d13-fafa92a0c7cc None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:19.210621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1c09-90cb-4bbd-9d13-fafa92a0c7cc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:19.211042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c1c09-90cb-4bbd-9d13-fafa92a0c7cc None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:19.214480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 905/1817] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:40:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:40:19.252836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75fbb-0000-4312-bd1d-5b2bdbfdd640 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:19.253130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75fbb-0000-4312-bd1d-5b2bdbfdd640 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:19.253439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef75fbb-0000-4312-bd1d-5b2bdbfdd640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:19.295355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9ef75fbb-0000-4312-bd1d-5b2bdbfdd640 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:19.296716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9ef75fbb-0000-4312-bd1d-5b2bdbfdd640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:19.329130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 913/1818] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:40:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:19.362254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c1c09-90cb-4bbd-9d13-fafa92a0c7cc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:19.378987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a18c1c09-90cb-4bbd-9d13-fafa92a0c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:19.423893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c1c09-90cb-4bbd-9d13-fafa92a0c7cc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:19.439343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487bb79-4720-4fe6-9e17-fefb4295be10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:19.454020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487bb79-4720-4fe6-9e17-fefb4295be10 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:19.454020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487bb79-4720-4fe6-9e17-fefb4295be10 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:19.454020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487bb79-4720-4fe6-9e17-fefb4295be10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:19.454020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487bb79-4720-4fe6-9e17-fefb4295be10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:19.475571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487bb79-4720-4fe6-9e17-fefb4295be10 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:19.499379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 906/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:20.487425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75fbb-0000-4312-bd1d-5b2bdbfdd640 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:20.487425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9ef75fbb-0000-4312-bd1d-5b2bdbfdd640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:20.685680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef75fbb-0000-4312-bd1d-5b2bdbfdd640 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:20.709422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:20.710712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:20.711265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:20.711937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] PATH_INFO: `/v3/users/490f0a45099049d0913405a0e3ed2852` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:20.714184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490f0a45099049d0913405a0e3ed2852)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:20.716547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:21.284334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490f0a45099049d0913405a0e3ed2852'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:21.285831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490f0a45099049d0913405a0e3ed2852'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:21.294422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490f0a45099049d0913405a0e3ed2852'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:21.314595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490f0a45099049d0913405a0e3ed2852'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:21.315487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490f0a45099049d0913405a0e3ed2852'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:21.719550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 914/1820] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:20 2022] DELETE /identity/v3/users/490f0a45099049d0913405a0e3ed2852 => generated 0 bytes in 1240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:21.726446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdedaf-dadb-4585-8b4c-b230a7c3860b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:21.728290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdedaf-dadb-4585-8b4c-b230a7c3860b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:21.729270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdedaf-dadb-4585-8b4c-b230a7c3860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:21.817782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-55cdedaf-dadb-4585-8b4c-b230a7c3860b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:21.844538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55cdedaf-dadb-4585-8b4c-b230a7c3860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:22.087021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 907/1821] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:22.099138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:22.100844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:22.250180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1b09d-3a73-4ab8-8831-c1cd41197f41 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:22.254733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:22.256776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:22.256776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:22.256776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:22.282428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:22.289618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:22.295778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 915/1822] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:22.384861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdedaf-dadb-4585-8b4c-b230a7c3860b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:22.386357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55cdedaf-dadb-4585-8b4c-b230a7c3860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:22.614483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdedaf-dadb-4585-8b4c-b230a7c3860b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:22.614483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:22.614483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:22.614483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:22.615905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:22.615905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:22.615905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:22.615905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:22.615905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 908/1823] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:23.664480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:23.686430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:23.714679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67432a-d6da-4fca-8f78-ca14a5a8697b service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:23.722164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:23.723334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:23.724385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:23.724718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] PATH_INFO: `/v3/projects/8d139aa5dbbf4f14af31ccdd7e199772` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:23.736397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d139aa5dbbf4f14af31ccdd7e199772)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:23.738922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:23.940581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d139aa5dbbf4f14af31ccdd7e199772', 'request_id': 'req-596ad861-21ab-4157-8d41-88605e4f77d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:24.355824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d139aa5dbbf4f14af31ccdd7e199772', 'request_id': 'req-596ad861-21ab-4157-8d41-88605e4f77d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:24.360923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d139aa5dbbf4f14af31ccdd7e199772', 'request_id': 'req-596ad861-21ab-4157-8d41-88605e4f77d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:24.376485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] The token cache is being invalidate because project 8d139aa5dbbf4f14af31ccdd7e199772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:24.376944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:24.377696 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:24.379629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 916/1824] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:23 2022] DELETE /identity/v3/projects/8d139aa5dbbf4f14af31ccdd7e199772 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:24.385038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:24.447835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae598e-118f-4b2b-a761-0971fccdd65e service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:24.571528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:24.572166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:24.572530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:24.572810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] PATH_INFO: `/v3/users/4a467901ca9a4e4888c439f365bd8665` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:24.574283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a467901ca9a4e4888c439f365bd8665)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:24.576727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:24.851295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a467901ca9a4e4888c439f365bd8665'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:24.876682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a467901ca9a4e4888c439f365bd8665'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:24.987100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a467901ca9a4e4888c439f365bd8665'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:24.989150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a467901ca9a4e4888c439f365bd8665'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:25.002222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a1ed011-bacd-41f9-b84a-0b4610284339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a467901ca9a4e4888c439f365bd8665'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:25.013731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 909/1825] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:24 2022] DELETE /identity/v3/users/4a467901ca9a4e4888c439f365bd8665 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:25.609260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:26.084716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:26.084716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:26.100718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad861-21ab-4157-8d41-88605e4f77d7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:26.171873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:26.172586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:26.172865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:26.173163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] PATH_INFO: `/v3/projects/7614c213571c481a87647b01df81f448` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:26.174388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7614c213571c481a87647b01df81f448)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:26.176575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:26.354353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7614c213571c481a87647b01df81f448', 'request_id': 'req-aa354697-4a21-42fe-886e-8e9e6e7b07a0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:26.454420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7614c213571c481a87647b01df81f448', 'request_id': 'req-aa354697-4a21-42fe-886e-8e9e6e7b07a0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:26.462220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7614c213571c481a87647b01df81f448', 'request_id': 'req-aa354697-4a21-42fe-886e-8e9e6e7b07a0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:26.472747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] The token cache is being invalidate because project 7614c213571c481a87647b01df81f448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:26.473039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:26.473708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-aa354697-4a21-42fe-886e-8e9e6e7b07a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:26.475285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 917/1826] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:26 2022] DELETE /identity/v3/projects/7614c213571c481a87647b01df81f448 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:26.480096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6464a-af92-4419-b81d-671492e4f629 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:26.480408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6464a-af92-4419-b81d-671492e4f629 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:26.480706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6464a-af92-4419-b81d-671492e4f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:26.500212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-bec6464a-af92-4419-b81d-671492e4f629 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:26.501422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bec6464a-af92-4419-b81d-671492e4f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:26.563459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 910/1827] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:26.572217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677742-eae7-4b34-bf5c-62be442fc986 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:26.579647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677742-eae7-4b34-bf5c-62be442fc986 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:26.579647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677742-eae7-4b34-bf5c-62be442fc986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:26.594359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-81677742-eae7-4b34-bf5c-62be442fc986 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:26.595704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-81677742-eae7-4b34-bf5c-62be442fc986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:26.604273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 918/1828] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:26.608800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6464a-af92-4419-b81d-671492e4f629 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:26.619149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6464a-af92-4419-b81d-671492e4f629 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:26.623912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:26.624639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:26.624834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:26.625109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:26.625775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:26.626136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:26.627759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:26.641191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 911/1829] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:26.646826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677742-eae7-4b34-bf5c-62be442fc986 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:26.658365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677742-eae7-4b34-bf5c-62be442fc986 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:26.666614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabca7-f364-4b6e-991d-43c41f629884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:26.678134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabca7-f364-4b6e-991d-43c41f629884 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:26.678134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabca7-f364-4b6e-991d-43c41f629884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:26.678134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcabca7-f364-4b6e-991d-43c41f629884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:26.678134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcabca7-f364-4b6e-991d-43c41f629884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:26.678134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcabca7-f364-4b6e-991d-43c41f629884 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:26.793741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 919/1830] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:26 2022] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:26.808027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:26.808570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9c368-beae-4bd6-99bb-1896a5359c92 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:26.871901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:26.871901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:26.871901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:26.871901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:26.872647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:26.873844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:26.984653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 912/1831] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:26 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:26.989800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabca7-f364-4b6e-991d-43c41f629884 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.001055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcabca7-f364-4b6e-991d-43c41f629884 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.011326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166f83-16a3-438a-babc-f67e393ab8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.012045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166f83-16a3-438a-babc-f67e393ab8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.012403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166f83-16a3-438a-babc-f67e393ab8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.012774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166f83-16a3-438a-babc-f67e393ab8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.013636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166f83-16a3-438a-babc-f67e393ab8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.015793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a166f83-16a3-438a-babc-f67e393ab8b8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:27.030094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.031917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:27.035921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 920/1832] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:27.037893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166f83-16a3-438a-babc-f67e393ab8b8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.045150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be393e32-f9db-4bd2-a618-03ee8c1ac62d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.048637 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a166f83-16a3-438a-babc-f67e393ab8b8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.050634 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.051706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.051706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.052095 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] PATH_INFO: `/v3/users/1342b635abd8439a8ba0050aa9bf5910` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.053360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1342b635abd8439a8ba0050aa9bf5910)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.053598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e001e9d-658e-4594-8a64-6dfbc4fe53a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.054328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001e9d-658e-4594-8a64-6dfbc4fe53a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.054610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001e9d-658e-4594-8a64-6dfbc4fe53a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.066382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001e9d-658e-4594-8a64-6dfbc4fe53a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.066382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e001e9d-658e-4594-8a64-6dfbc4fe53a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.066618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:27.066712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e001e9d-658e-4594-8a64-6dfbc4fe53a8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:27.072151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 921/1833] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:27.076295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e001e9d-658e-4594-8a64-6dfbc4fe53a8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.086535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e001e9d-658e-4594-8a64-6dfbc4fe53a8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.091465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cecd61-b090-45a3-bfcf-24af4488c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.092110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cecd61-b090-45a3-bfcf-24af4488c932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.092417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cecd61-b090-45a3-bfcf-24af4488c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.092689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cecd61-b090-45a3-bfcf-24af4488c932 admin admin] PATH_INFO: `/v3/projects/9f61d924502b4a6bb4667068676d823a/users/db224ec7cce44bccb847e39486ca2956/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.108095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cecd61-b090-45a3-bfcf-24af4488c932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f61d924502b4a6bb4667068676d823a, user_id=db224ec7cce44bccb847e39486ca2956, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.111089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cecd61-b090-45a3-bfcf-24af4488c932 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:27.233544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:27.235352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 922/1834] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:27 2022] PUT /identity/v3/projects/9f61d924502b4a6bb4667068676d823a/users/db224ec7cce44bccb847e39486ca2956/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:27.246325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186c753-3a82-475f-90c8-70174171039e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.246325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186c753-3a82-475f-90c8-70174171039e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.246621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186c753-3a82-475f-90c8-70174171039e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.264774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1342b635abd8439a8ba0050aa9bf5910'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:27.280551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9186c753-3a82-475f-90c8-70174171039e None None] MFA Rules not processed for user `db224ec7cce44bccb847e39486ca2956`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:27.281776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9186c753-3a82-475f-90c8-70174171039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:27.285861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1342b635abd8439a8ba0050aa9bf5910'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:27.354953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 923/1835] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:27.359231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186c753-3a82-475f-90c8-70174171039e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.408861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1342b635abd8439a8ba0050aa9bf5910'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:27.409679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1342b635abd8439a8ba0050aa9bf5910'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:27.419450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2adcd032-56b9-4b0a-8325-83df21414e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1342b635abd8439a8ba0050aa9bf5910'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:27.428198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 913/1836] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:27 2022] DELETE /identity/v3/users/1342b635abd8439a8ba0050aa9bf5910 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:27.430286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186c753-3a82-475f-90c8-70174171039e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.432617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca882104-a9ee-4bc7-beb4-846ccb0c9ad7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.434336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca882104-a9ee-4bc7-beb4-846ccb0c9ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.434743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca882104-a9ee-4bc7-beb4-846ccb0c9ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.463118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ca882104-a9ee-4bc7-beb4-846ccb0c9ad7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:27.464484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ca882104-a9ee-4bc7-beb4-846ccb0c9ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:27.496071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.496913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.497295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.497636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.498451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.500430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:27.537172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 914/1837] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:27.547075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca882104-a9ee-4bc7-beb4-846ccb0c9ad7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.548424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ca882104-a9ee-4bc7-beb4-846ccb0c9ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:27.608459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca882104-a9ee-4bc7-beb4-846ccb0c9ad7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.610126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 924/1838] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:27 2022] POST /identity/v3/projects => generated 391 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:27.615143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.616747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:27.660082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56823-6a1a-4645-a698-e4ffcc99cca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.660693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56823-6a1a-4645-a698-e4ffcc99cca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.660949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56823-6a1a-4645-a698-e4ffcc99cca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.661218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e56823-6a1a-4645-a698-e4ffcc99cca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.683935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf38b-9398-4183-9bab-f4f5e9090c88 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.689085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e341c2e-2216-4949-b4a9-92de60f364b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.690180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e341c2e-2216-4949-b4a9-92de60f364b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.692070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e341c2e-2216-4949-b4a9-92de60f364b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.692070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e341c2e-2216-4949-b4a9-92de60f364b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.692531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e341c2e-2216-4949-b4a9-92de60f364b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.694611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e341c2e-2216-4949-b4a9-92de60f364b0 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:27.732768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e56823-6a1a-4645-a698-e4ffcc99cca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.734264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e56823-6a1a-4645-a698-e4ffcc99cca3 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:27.744683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 915/1839] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:27.849574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 925/1840] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:27 2022] POST /identity/v3/users => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:27.853725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56823-6a1a-4645-a698-e4ffcc99cca3 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.864076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e56823-6a1a-4645-a698-e4ffcc99cca3 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.868733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7509e-5be1-40c5-ad9a-6e701aa3b572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.869329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7509e-5be1-40c5-ad9a-6e701aa3b572 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.869609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7509e-5be1-40c5-ad9a-6e701aa3b572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.869879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7509e-5be1-40c5-ad9a-6e701aa3b572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.870581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7509e-5be1-40c5-ad9a-6e701aa3b572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.872229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7509e-5be1-40c5-ad9a-6e701aa3b572 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:27.883192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 916/1841] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:27.889691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e341c2e-2216-4949-b4a9-92de60f364b0 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:27.899782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e341c2e-2216-4949-b4a9-92de60f364b0 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:27.904521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb329-49c2-40f8-ac97-878c2346268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:27.905179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb329-49c2-40f8-ac97-878c2346268b admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:27.905457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb329-49c2-40f8-ac97-878c2346268b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:27.905730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcb329-49c2-40f8-ac97-878c2346268b admin admin] PATH_INFO: `/v3/projects/06fc082cfdc94f9c92f2668829ab6de1/users/366d28fc493248bbab90dd10d2120c6f/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:27.921278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcb329-49c2-40f8-ac97-878c2346268b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fc082cfdc94f9c92f2668829ab6de1, user_id=366d28fc493248bbab90dd10d2120c6f, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:27.924002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcb329-49c2-40f8-ac97-878c2346268b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:28.073414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 926/1842] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:27 2022] PUT /identity/v3/projects/06fc082cfdc94f9c92f2668829ab6de1/users/366d28fc493248bbab90dd10d2120c6f/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:28.077075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7509e-5be1-40c5-ad9a-6e701aa3b572 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:28.092027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7509e-5be1-40c5-ad9a-6e701aa3b572 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:28.181394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d55243-0fc1-4a46-9a60-f030a2f61b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:28.181394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55243-0fc1-4a46-9a60-f030a2f61b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:28.181394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55243-0fc1-4a46-9a60-f030a2f61b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:28.181394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55243-0fc1-4a46-9a60-f030a2f61b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:28.187873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d55243-0fc1-4a46-9a60-f030a2f61b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:28.187873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d55243-0fc1-4a46-9a60-f030a2f61b93 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:28.196278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 917/1843] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:28.200586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb329-49c2-40f8-ac97-878c2346268b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:28.210792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcb329-49c2-40f8-ac97-878c2346268b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:28.215468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:28.216196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:28.216541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:28.216903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] PATH_INFO: `/v3/projects/06fc082cfdc94f9c92f2668829ab6de1/users/366d28fc493248bbab90dd10d2120c6f/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:28.218898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fc082cfdc94f9c92f2668829ab6de1, user_id=366d28fc493248bbab90dd10d2120c6f, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:28.221579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:28.240069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 927/1844] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:28 2022] PUT /identity/v3/projects/06fc082cfdc94f9c92f2668829ab6de1/users/366d28fc493248bbab90dd10d2120c6f/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:28.252232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad1d8-0538-4c3b-bd93-6bd94a27b5d9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:28.252652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad1d8-0538-4c3b-bd93-6bd94a27b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:28.253275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad1d8-0538-4c3b-bd93-6bd94a27b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:28.282833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0b1ad1d8-0538-4c3b-bd93-6bd94a27b5d9 None None] MFA Rules not processed for user `366d28fc493248bbab90dd10d2120c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:28.284080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0b1ad1d8-0538-4c3b-bd93-6bd94a27b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:28.309128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:28.311071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:28.366618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 918/1845] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:28.377615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ad1d8-0538-4c3b-bd93-6bd94a27b5d9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:28.379055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eca1ba-7a44-47da-96c0-f184e02bd597 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:28.383967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0b1ad1d8-0538-4c3b-bd93-6bd94a27b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:28.384881 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:28.385671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:28.386233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:28.386534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] PATH_INFO: `/v3/projects/97bd8928189047b19675a9095ad261a0` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:28.387749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97bd8928189047b19675a9095ad261a0)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:28.391087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:28.465337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ad1d8-0538-4c3b-bd93-6bd94a27b5d9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:28.469223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69164-772c-4f81-b4a1-d52eccda198f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:28.470152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69164-772c-4f81-b4a1-d52eccda198f service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:28.470622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69164-772c-4f81-b4a1-d52eccda198f service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:28.471050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69164-772c-4f81-b4a1-d52eccda198f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:28.485252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e69164-772c-4f81-b4a1-d52eccda198f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:28.486900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e69164-772c-4f81-b4a1-d52eccda198f service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:28.497619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 919/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:28.531308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97bd8928189047b19675a9095ad261a0', 'request_id': 'req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.592373 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69164-772c-4f81-b4a1-d52eccda198f service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:28.604988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69164-772c-4f81-b4a1-d52eccda198f service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:28.615044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97bd8928189047b19675a9095ad261a0', 'request_id': 'req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.627053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97bd8928189047b19675a9095ad261a0', 'request_id': 'req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.642747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] The token cache is being invalidate because project 97bd8928189047b19675a9095ad261a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:28.643043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.647973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.647973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 928/1847] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:28 2022] DELETE /identity/v3/projects/97bd8928189047b19675a9095ad261a0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:28.651363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:28.652967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:28.662396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:28.663009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:28.663455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:28.663877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:28.666389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:28.723131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5b0d5-3ea6-4a41-9d6e-4d895f8597a7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:28.728618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:28.729263 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:28.729540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:28.729812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] PATH_INFO: `/v3/users/f08f068fb5f648139dc9787678982797` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:28.730996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08f068fb5f648139dc9787678982797)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:28.733247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:28.743255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:28.744141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:28.756305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 920/1848] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:28.806058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:28.807934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:28.823643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2b1cc-1ca6-4b76-94e5-83a602eea19d service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:28.828813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:28.829593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:28.829793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:28.830157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] PATH_INFO: `/v3/users/8d5f6f337cb2467bb111fd0f332fac9b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:28.831987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5f6f337cb2467bb111fd0f332fac9b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:28.834149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:28.966801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08f068fb5f648139dc9787678982797'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.967636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08f068fb5f648139dc9787678982797'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.975317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08f068fb5f648139dc9787678982797'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.987274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08f068fb5f648139dc9787678982797'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:28.988142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c661dba2-6607-498f-90cf-ff8c62dfc5aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08f068fb5f648139dc9787678982797'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:29.119857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 929/1849] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:28 2022] DELETE /identity/v3/users/f08f068fb5f648139dc9787678982797 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:29.120677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5f6f337cb2467bb111fd0f332fac9b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:29.139891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5f6f337cb2467bb111fd0f332fac9b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:29.311909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5f6f337cb2467bb111fd0f332fac9b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:29.312766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5f6f337cb2467bb111fd0f332fac9b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:29.326155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5f6f337cb2467bb111fd0f332fac9b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:29.355774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 921/1850] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:28 2022] DELETE /identity/v3/users/8d5f6f337cb2467bb111fd0f332fac9b => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:29.360469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92b99-e14f-4fb7-8310-ac5fba6f864f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:29.360969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92b99-e14f-4fb7-8310-ac5fba6f864f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:29.361284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb92b99-e14f-4fb7-8310-ac5fba6f864f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:29.403475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-acb92b99-e14f-4fb7-8310-ac5fba6f864f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:29.404749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-acb92b99-e14f-4fb7-8310-ac5fba6f864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:29.532462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 930/1851] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:29.543195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:29.544705 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:29.635464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e2e45-1a93-4763-9325-3187dba5ea0b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:29.639468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25fced-2f3c-4428-8b3d-c0eed1c62982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:29.640090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fced-2f3c-4428-8b3d-c0eed1c62982 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:29.640370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fced-2f3c-4428-8b3d-c0eed1c62982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:29.640807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25fced-2f3c-4428-8b3d-c0eed1c62982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:29.651591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25fced-2f3c-4428-8b3d-c0eed1c62982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:29.653133 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25fced-2f3c-4428-8b3d-c0eed1c62982 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:29.665252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 922/1852] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:29.682540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:29.725808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb92b99-e14f-4fb7-8310-ac5fba6f864f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:29.728214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-acb92b99-e14f-4fb7-8310-ac5fba6f864f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:29.773034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb92b99-e14f-4fb7-8310-ac5fba6f864f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:29.796211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:29.797292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:29.797640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:29.798090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] PATH_INFO: `/v3/projects/97d3a8a959754abfaf1ecfa3b9ffbb6d` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:29.799805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d3a8a959754abfaf1ecfa3b9ffbb6d)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:29.802439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:29.987649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d3a8a959754abfaf1ecfa3b9ffbb6d', 'request_id': 'req-5b16016b-31ad-4c5e-937f-162759266e03'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.060449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d3a8a959754abfaf1ecfa3b9ffbb6d', 'request_id': 'req-5b16016b-31ad-4c5e-937f-162759266e03'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.067702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d3a8a959754abfaf1ecfa3b9ffbb6d', 'request_id': 'req-5b16016b-31ad-4c5e-937f-162759266e03'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.079805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] The token cache is being invalidate because project 97d3a8a959754abfaf1ecfa3b9ffbb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:30.080052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.080722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5b16016b-31ad-4c5e-937f-162759266e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.082976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 931/1853] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:29 2022] DELETE /identity/v3/projects/97d3a8a959754abfaf1ecfa3b9ffbb6d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:30.087864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe3e4-16fa-4d66-b581-a3094aab36ca None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.088147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe3e4-16fa-4d66-b581-a3094aab36ca None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.088423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fe3e4-16fa-4d66-b581-a3094aab36ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.110660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c26fe3e4-16fa-4d66-b581-a3094aab36ca None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:30.115291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c26fe3e4-16fa-4d66-b581-a3094aab36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:30.209154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 923/1854] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:30.222160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31284d-4dca-4d67-b4f4-9ef1fbaeb6bf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.222561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31284d-4dca-4d67-b4f4-9ef1fbaeb6bf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.222783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31284d-4dca-4d67-b4f4-9ef1fbaeb6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.256386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8c31284d-4dca-4d67-b4f4-9ef1fbaeb6bf None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:30.257770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8c31284d-4dca-4d67-b4f4-9ef1fbaeb6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:30.266531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 932/1855] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:30.273117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe3e4-16fa-4d66-b581-a3094aab36ca None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:30.285364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fe3e4-16fa-4d66-b581-a3094aab36ca None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:30.293110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:30.293967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.294329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.294567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31284d-4dca-4d67-b4f4-9ef1fbaeb6bf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:30.294664 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.295793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:30.296254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:30.296495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8c31284d-4dca-4d67-b4f4-9ef1fbaeb6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:30.298776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:30.314802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31284d-4dca-4d67-b4f4-9ef1fbaeb6bf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:30.316446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 924/1856] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:30.322403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:30.323058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:30.323812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.324256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.324529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] PATH_INFO: `/v3/projects/b99562e2dd0b41418a7ee076299ca566` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.325905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99562e2dd0b41418a7ee076299ca566)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:30.328029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:30.335532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:30.339660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c914814-18c4-42d0-a285-50574ef882e1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:30.345107 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8987ecf-6437-42ad-9b12-7c7ce56e6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:30.345891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8987ecf-6437-42ad-9b12-7c7ce56e6939 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.346250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8987ecf-6437-42ad-9b12-7c7ce56e6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.346596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8987ecf-6437-42ad-9b12-7c7ce56e6939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.347716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8987ecf-6437-42ad-9b12-7c7ce56e6939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:30.350012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8987ecf-6437-42ad-9b12-7c7ce56e6939 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:30.449342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99562e2dd0b41418a7ee076299ca566', 'request_id': 'req-477235d1-5a3d-46a4-ae48-10ce7324f836'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.462676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 925/1857] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:30 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:30.466774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8987ecf-6437-42ad-9b12-7c7ce56e6939 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:30.506085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99562e2dd0b41418a7ee076299ca566', 'request_id': 'req-477235d1-5a3d-46a4-ae48-10ce7324f836'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.508781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:30.516827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99562e2dd0b41418a7ee076299ca566', 'request_id': 'req-477235d1-5a3d-46a4-ae48-10ce7324f836'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.543267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] The token cache is being invalidate because project b99562e2dd0b41418a7ee076299ca566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:30.543639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.545950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:30.548368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8987ecf-6437-42ad-9b12-7c7ce56e6939 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:30.551128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 933/1858] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:30 2022] DELETE /identity/v3/projects/b99562e2dd0b41418a7ee076299ca566 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:30.555246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:30.557909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:30.559598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:30.559781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.559781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.559781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.560625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:30.563571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:30.661870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 926/1859] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:30 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:30.667637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:30.671731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:30.709398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48a2d-c586-4802-a9cc-5d6d19791a49 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:30.710460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477235d1-5a3d-46a4-ae48-10ce7324f836 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:30.718733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:30.719673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f307280-00f0-4280-8bae-cd5ff365fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:30.720497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f307280-00f0-4280-8bae-cd5ff365fc0a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.722038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.722038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.724579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f307280-00f0-4280-8bae-cd5ff365fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.724579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f307280-00f0-4280-8bae-cd5ff365fc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.724579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f307280-00f0-4280-8bae-cd5ff365fc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:30.724868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] PATH_INFO: `/v3/users/de92bb2f4bb54289ab5e3d32b1da676a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.726268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f307280-00f0-4280-8bae-cd5ff365fc0a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:30.727471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de92bb2f4bb54289ab5e3d32b1da676a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:30.730214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:30.754711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 927/1860] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:30.770847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f307280-00f0-4280-8bae-cd5ff365fc0a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:30.796079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f307280-00f0-4280-8bae-cd5ff365fc0a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:30.821893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94aac1-63bd-4480-b629-a2f1c3a0dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:30.822560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94aac1-63bd-4480-b629-a2f1c3a0dd68 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.822856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94aac1-63bd-4480-b629-a2f1c3a0dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.823138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94aac1-63bd-4480-b629-a2f1c3a0dd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.824193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94aac1-63bd-4480-b629-a2f1c3a0dd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:30.825806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94aac1-63bd-4480-b629-a2f1c3a0dd68 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:30.838910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 928/1861] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:30.842994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94aac1-63bd-4480-b629-a2f1c3a0dd68 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:30.858874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94aac1-63bd-4480-b629-a2f1c3a0dd68 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:30.865820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3546be-21d0-474c-9e8f-d3d2193287aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:30.866579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3546be-21d0-474c-9e8f-d3d2193287aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:30.866955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3546be-21d0-474c-9e8f-d3d2193287aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:30.867289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3546be-21d0-474c-9e8f-d3d2193287aa admin admin] PATH_INFO: `/v3/projects/efaf2eb1ef3944c5a047e335342b7ff3/users/6713c37cc25c495c84602b1713125c3b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:30.886005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3546be-21d0-474c-9e8f-d3d2193287aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=efaf2eb1ef3944c5a047e335342b7ff3, user_id=6713c37cc25c495c84602b1713125c3b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:30.888884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3546be-21d0-474c-9e8f-d3d2193287aa admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:31.096332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 929/1862] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:30 2022] PUT /identity/v3/projects/efaf2eb1ef3944c5a047e335342b7ff3/users/6713c37cc25c495c84602b1713125c3b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:31.098880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6e1b-ad4d-4b43-861f-78b062569f7d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:31.099235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6e1b-ad4d-4b43-861f-78b062569f7d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:31.099603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6e1b-ad4d-4b43-861f-78b062569f7d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:31.100953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 930/1863] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:40:31.107493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de92bb2f4bb54289ab5e3d32b1da676a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:31.107644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f5b1b-8e26-4027-9b16-0107f6ae3318 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:31.107983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f5b1b-8e26-4027-9b16-0107f6ae3318 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:31.108188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de92bb2f4bb54289ab5e3d32b1da676a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:31.108301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f5b1b-8e26-4027-9b16-0107f6ae3318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:31.116420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de92bb2f4bb54289ab5e3d32b1da676a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:31.130076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de92bb2f4bb54289ab5e3d32b1da676a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:31.130580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-239f5b1b-8e26-4027-9b16-0107f6ae3318 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:31.131108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de92bb2f4bb54289ab5e3d32b1da676a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:31.131871 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-239f5b1b-8e26-4027-9b16-0107f6ae3318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:31.201959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 931/1864] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:31.203255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead5501-c79b-4195-a7c4-13bfce608b7b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:31.203541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead5501-c79b-4195-a7c4-13bfce608b7b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:31.203813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead5501-c79b-4195-a7c4-13bfce608b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:31.248520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-dead5501-c79b-4195-a7c4-13bfce608b7b None None] MFA Rules not processed for user `6713c37cc25c495c84602b1713125c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:31.249746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dead5501-c79b-4195-a7c4-13bfce608b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:31.261356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 934/1865] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:30 2022] DELETE /identity/v3/users/de92bb2f4bb54289ab5e3d32b1da676a => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:31.264979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:31.266504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:31.411640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 932/1866] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:31.437617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead5501-c79b-4195-a7c4-13bfce608b7b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:31.439205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dead5501-c79b-4195-a7c4-13bfce608b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:31.447765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86e7b-e0c6-47c4-ae69-a81a5f28681a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:31.459412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e359a-e67c-42dd-af26-79a27ee284db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:31.460131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e359a-e67c-42dd-af26-79a27ee284db service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:31.460375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e359a-e67c-42dd-af26-79a27ee284db service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:31.460647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e359a-e67c-42dd-af26-79a27ee284db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:31.470560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e359a-e67c-42dd-af26-79a27ee284db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:31.472417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e359a-e67c-42dd-af26-79a27ee284db service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:31.493111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 935/1867] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:31.530869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead5501-c79b-4195-a7c4-13bfce608b7b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:31.638986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:31.640482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:31.640771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:31.641072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:31.641749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:31.644229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:31.736438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 933/1868] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:31 2022] POST /identity/v3/projects => generated 387 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:31.741598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e359a-e67c-42dd-af26-79a27ee284db service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:31.762200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:31.762736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e359a-e67c-42dd-af26-79a27ee284db service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:31.764014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:31.841540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de640-1fca-4564-8a22-da25b6eb4cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:31.845003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de640-1fca-4564-8a22-da25b6eb4cde admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:31.845003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de640-1fca-4564-8a22-da25b6eb4cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:31.845003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de640-1fca-4564-8a22-da25b6eb4cde admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:31.845003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57de640-1fca-4564-8a22-da25b6eb4cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:31.845569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57de640-1fca-4564-8a22-da25b6eb4cde admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:31.877605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a77cb-5c52-438f-b781-ce73b9614509 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:31.892231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:31.893005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:31.893378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:31.895136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] PATH_INFO: `/v3/projects/e960bd6deb844597bca894ab51267e94` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:31.898097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e960bd6deb844597bca894ab51267e94)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:31.901564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:32.023207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 936/1869] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:31 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:32.028053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de640-1fca-4564-8a22-da25b6eb4cde admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:32.053245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de640-1fca-4564-8a22-da25b6eb4cde admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:32.060194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5090-773a-4e8f-a7bf-b96ca6d13906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:32.062111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5090-773a-4e8f-a7bf-b96ca6d13906 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.062699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5090-773a-4e8f-a7bf-b96ca6d13906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.063447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5090-773a-4e8f-a7bf-b96ca6d13906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.064944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b5090-773a-4e8f-a7bf-b96ca6d13906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:32.068087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b5090-773a-4e8f-a7bf-b96ca6d13906 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:32.088902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 937/1870] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:32.092960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5090-773a-4e8f-a7bf-b96ca6d13906 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:32.117086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5090-773a-4e8f-a7bf-b96ca6d13906 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:32.126480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320d85-d81b-46cf-b511-fbabeffb4974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:32.127178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320d85-d81b-46cf-b511-fbabeffb4974 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.127476 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320d85-d81b-46cf-b511-fbabeffb4974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.127747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320d85-d81b-46cf-b511-fbabeffb4974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.129435 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d320d85-d81b-46cf-b511-fbabeffb4974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:32.131523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d320d85-d81b-46cf-b511-fbabeffb4974 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:32.156268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 938/1871] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:32.157364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320d85-d81b-46cf-b511-fbabeffb4974 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:32.181213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e960bd6deb844597bca894ab51267e94', 'request_id': 'req-71fc651a-f6d6-4316-b04e-a93875dfc758'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.192292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320d85-d81b-46cf-b511-fbabeffb4974 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:32.266125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e960bd6deb844597bca894ab51267e94', 'request_id': 'req-71fc651a-f6d6-4316-b04e-a93875dfc758'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.274716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e960bd6deb844597bca894ab51267e94', 'request_id': 'req-71fc651a-f6d6-4316-b04e-a93875dfc758'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.298890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] The token cache is being invalidate because project e960bd6deb844597bca894ab51267e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:32.299200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.300980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-71fc651a-f6d6-4316-b04e-a93875dfc758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.308566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 934/1872] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:31 2022] DELETE /identity/v3/projects/e960bd6deb844597bca894ab51267e94 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:32.313172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0da8e-2f30-405b-be41-7abe1859c8ca None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.313459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0da8e-2f30-405b-be41-7abe1859c8ca None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.313861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0da8e-2f30-405b-be41-7abe1859c8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.340122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10265e38-fd31-47a5-9b74-1034f2d5f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:32.340996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10265e38-fd31-47a5-9b74-1034f2d5f202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.341369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10265e38-fd31-47a5-9b74-1034f2d5f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.341720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10265e38-fd31-47a5-9b74-1034f2d5f202 admin admin] PATH_INFO: `/v3/projects/6fa43587e2d34679a447f07d3344abf3/users/fde954e8636d407da5062f69b31c79e5/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.352355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-aca0da8e-2f30-405b-be41-7abe1859c8ca None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:32.354305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-aca0da8e-2f30-405b-be41-7abe1859c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:32.366540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 935/1873] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:32.368708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10265e38-fd31-47a5-9b74-1034f2d5f202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa43587e2d34679a447f07d3344abf3, user_id=fde954e8636d407da5062f69b31c79e5, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:32.372199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10265e38-fd31-47a5-9b74-1034f2d5f202 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:32.375205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32392e1-ae35-488d-b579-22fa1d2c46d2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.375492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32392e1-ae35-488d-b579-22fa1d2c46d2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.375766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32392e1-ae35-488d-b579-22fa1d2c46d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.409717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e32392e1-ae35-488d-b579-22fa1d2c46d2 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:32.411010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e32392e1-ae35-488d-b579-22fa1d2c46d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:32.423322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 936/1874] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:32.427660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32392e1-ae35-488d-b579-22fa1d2c46d2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:32.439701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32392e1-ae35-488d-b579-22fa1d2c46d2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:32.448186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:32.448862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.452152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.452152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.452152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:32.452474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:32.452686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 939/1875] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:32 2022] PUT /identity/v3/projects/6fa43587e2d34679a447f07d3344abf3/users/fde954e8636d407da5062f69b31c79e5/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:32.457959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:32.468573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc534-de57-4626-82b1-4d21da597caa None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.470089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc534-de57-4626-82b1-4d21da597caa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.470579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fc534-de57-4626-82b1-4d21da597caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.490004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 937/1876] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:32.491433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:32.507242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a7252-6e06-460f-bfc9-96a7d8e8a39b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:32.515741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-916fc534-de57-4626-82b1-4d21da597caa None None] MFA Rules not processed for user `fde954e8636d407da5062f69b31c79e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:32.517041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-916fc534-de57-4626-82b1-4d21da597caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:32.592916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:32.593892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.594229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.599464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.599464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:32.599464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:32.607512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 940/1877] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:32.607512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fc534-de57-4626-82b1-4d21da597caa None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:32.608344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-916fc534-de57-4626-82b1-4d21da597caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:32.622778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fc534-de57-4626-82b1-4d21da597caa None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:32.627472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:32.629127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.629413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.629847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] PATH_INFO: `/v3/users/b312e9920a36489389bed0f031ae1f12` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.631004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b312e9920a36489389bed0f031ae1f12)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:32.634116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:32.699963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 938/1878] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:32 2022] POST /identity/v3/projects => generated 359 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:32.699963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:32.699963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:32.773710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70503c2d-1d66-40e5-9664-b37c85952bc3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:32.783582 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:32.784681 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:32.785008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:32.785376 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:32.786647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:32.790480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:32.893042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b312e9920a36489389bed0f031ae1f12'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.893754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b312e9920a36489389bed0f031ae1f12'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.900907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b312e9920a36489389bed0f031ae1f12'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.914125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b312e9920a36489389bed0f031ae1f12'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.914882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b312e9920a36489389bed0f031ae1f12'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:32.931983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 939/1879] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:32 2022] POST /identity/v3/projects => generated 387 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:32.932464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:32.934094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:33.009205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e580b1a-6ad6-4b2e-aee2-3859889fd2e9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.009912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 941/1880] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:32 2022] DELETE /identity/v3/users/b312e9920a36489389bed0f031ae1f12 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:33.010829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.012553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:33.040587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:33.084197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:33.121934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a72d3-ae82-4bc5-a8c2-c7c010c1b5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.122609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a72d3-ae82-4bc5-a8c2-c7c010c1b5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.122909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a72d3-ae82-4bc5-a8c2-c7c010c1b5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.123186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a72d3-ae82-4bc5-a8c2-c7c010c1b5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.123841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a72d3-ae82-4bc5-a8c2-c7c010c1b5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.125842 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a72d3-ae82-4bc5-a8c2-c7c010c1b5a9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.129538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfe820-a192-48c4-9ce0-8471f4e7e8f5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.134798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e1b6f-578c-42ca-ae8d-9727ac0af4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.135451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e1b6f-578c-42ca-ae8d-9727ac0af4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.135736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e1b6f-578c-42ca-ae8d-9727ac0af4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.136013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e1b6f-578c-42ca-ae8d-9727ac0af4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.136672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e1b6f-578c-42ca-ae8d-9727ac0af4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.138918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e1b6f-578c-42ca-ae8d-9727ac0af4c4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.223451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 940/1881] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:32 2022] POST /identity/v3/users => generated 280 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:33.224795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfd366-6ca5-4fcd-a2ef-57ae57521b85 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.225046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfd366-6ca5-4fcd-a2ef-57ae57521b85 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.231081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfd366-6ca5-4fcd-a2ef-57ae57521b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.251929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c4cfd366-6ca5-4fcd-a2ef-57ae57521b85 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:33.251929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c4cfd366-6ca5-4fcd-a2ef-57ae57521b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:33.260679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 942/1882] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:33 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:33.263926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e1b6f-578c-42ca-ae8d-9727ac0af4c4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.270827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 941/1883] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:33.272005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfd366-6ca5-4fcd-a2ef-57ae57521b85 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.287694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e1b6f-578c-42ca-ae8d-9727ac0af4c4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.293326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfd366-6ca5-4fcd-a2ef-57ae57521b85 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.301360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.302273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.303660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.304284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.307319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.309253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88149b33-d7a8-4165-880a-7a75a94fb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.311366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88149b33-d7a8-4165-880a-7a75a94fb594 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.312072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.312497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88149b33-d7a8-4165-880a-7a75a94fb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.313604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88149b33-d7a8-4165-880a-7a75a94fb594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.314549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88149b33-d7a8-4165-880a-7a75a94fb594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.327376 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88149b33-d7a8-4165-880a-7a75a94fb594 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.332649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 943/1884] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:33.332649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.334388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:33.341591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 942/1885] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:33.341591 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88149b33-d7a8-4165-880a-7a75a94fb594 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.356600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88149b33-d7a8-4165-880a-7a75a94fb594 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.365137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290d32e-76bb-419c-a38e-52d95b8abad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.365905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290d32e-76bb-419c-a38e-52d95b8abad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.366229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290d32e-76bb-419c-a38e-52d95b8abad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.366505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290d32e-76bb-419c-a38e-52d95b8abad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.367275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290d32e-76bb-419c-a38e-52d95b8abad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.370241 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290d32e-76bb-419c-a38e-52d95b8abad3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.388984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 943/1886] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:33.390748 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290d32e-76bb-419c-a38e-52d95b8abad3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.413522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290d32e-76bb-419c-a38e-52d95b8abad3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.415929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca86c19-14eb-4ff0-8965-d8739b7901f8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.419482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84a3a-f102-4e1d-bf69-8dc68aff3fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.420199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84a3a-f102-4e1d-bf69-8dc68aff3fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.420488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84a3a-f102-4e1d-bf69-8dc68aff3fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.420766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f84a3a-f102-4e1d-bf69-8dc68aff3fd0 admin admin] PATH_INFO: `/v3/projects/835fa89bb3c647738111f6bdf53b06da/users/238474fd20eb40df8051b8af33f53157/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.421768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f32f01-ca93-45e9-8e4b-85fe70eba401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.422454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f32f01-ca93-45e9-8e4b-85fe70eba401 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.422737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f32f01-ca93-45e9-8e4b-85fe70eba401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.423012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f32f01-ca93-45e9-8e4b-85fe70eba401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.436368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f32f01-ca93-45e9-8e4b-85fe70eba401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.437597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f32f01-ca93-45e9-8e4b-85fe70eba401 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.441673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f84a3a-f102-4e1d-bf69-8dc68aff3fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835fa89bb3c647738111f6bdf53b06da, user_id=238474fd20eb40df8051b8af33f53157, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.446509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f84a3a-f102-4e1d-bf69-8dc68aff3fd0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.449128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 944/1887] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:33.450239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f32f01-ca93-45e9-8e4b-85fe70eba401 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.461237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f32f01-ca93-45e9-8e4b-85fe70eba401 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.467380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb130a-6592-4ed8-880e-c5a73eb285f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.468383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb130a-6592-4ed8-880e-c5a73eb285f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.468886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb130a-6592-4ed8-880e-c5a73eb285f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.469883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb130a-6592-4ed8-880e-c5a73eb285f2 admin admin] PATH_INFO: `/v3/projects/37f7080b6e0742c39c0a29695fd90730/users/9ab17d9d56c34cf5b9b84f0175453d66/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.488235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb130a-6592-4ed8-880e-c5a73eb285f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f7080b6e0742c39c0a29695fd90730, user_id=9ab17d9d56c34cf5b9b84f0175453d66, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.491114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb130a-6592-4ed8-880e-c5a73eb285f2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.537445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 944/1888] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:33 2022] PUT /identity/v3/projects/835fa89bb3c647738111f6bdf53b06da/users/238474fd20eb40df8051b8af33f53157/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:33.542036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84a3a-f102-4e1d-bf69-8dc68aff3fd0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.598071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 945/1889] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:33 2022] PUT /identity/v3/projects/37f7080b6e0742c39c0a29695fd90730/users/9ab17d9d56c34cf5b9b84f0175453d66/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:33.599844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bfda8-a01e-4853-ab57-68b2a020d575 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.600133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bfda8-a01e-4853-ab57-68b2a020d575 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.600558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bfda8-a01e-4853-ab57-68b2a020d575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.650346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f84a3a-f102-4e1d-bf69-8dc68aff3fd0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.673422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a65bfda8-a01e-4853-ab57-68b2a020d575 None None] MFA Rules not processed for user `9ab17d9d56c34cf5b9b84f0175453d66`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:33.678765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a65bfda8-a01e-4853-ab57-68b2a020d575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:33.806089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.806759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.807127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.807314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.808227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.809740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.823754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 946/1890] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:33.827640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 945/1891] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:33.840714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bfda8-a01e-4853-ab57-68b2a020d575 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.868537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:33.869265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bfda8-a01e-4853-ab57-68b2a020d575 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:33.871440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:33.875841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7911d03-5388-468f-bb68-88efcd2c1264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:33.876995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911d03-5388-468f-bb68-88efcd2c1264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.877488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911d03-5388-468f-bb68-88efcd2c1264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.878114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911d03-5388-468f-bb68-88efcd2c1264 admin admin] PATH_INFO: `/v3/projects/835fa89bb3c647738111f6bdf53b06da/users/238474fd20eb40df8051b8af33f53157/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.882217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7911d03-5388-468f-bb68-88efcd2c1264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835fa89bb3c647738111f6bdf53b06da, user_id=238474fd20eb40df8051b8af33f53157, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:33.885928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7911d03-5388-468f-bb68-88efcd2c1264 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:33.910359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 947/1892] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:33 2022] PUT /identity/v3/projects/835fa89bb3c647738111f6bdf53b06da/users/238474fd20eb40df8051b8af33f53157/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:33.915587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336d72-0bed-41dc-8417-e0689eb33335 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:33.915868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336d72-0bed-41dc-8417-e0689eb33335 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:33.916221 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1336d72-0bed-41dc-8417-e0689eb33335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:33.954755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d1336d72-0bed-41dc-8417-e0689eb33335 None None] MFA Rules not processed for user `238474fd20eb40df8051b8af33f53157`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:33.956663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d1336d72-0bed-41dc-8417-e0689eb33335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:33.980229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd2619-d634-45d2-abd9-8fc850fa362e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:34.049517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c5ce5-b1c9-435a-b45e-b1ddfb4afdf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:34.050929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c5ce5-b1c9-435a-b45e-b1ddfb4afdf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:34.051259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c5ce5-b1c9-435a-b45e-b1ddfb4afdf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:34.051608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c5ce5-b1c9-435a-b45e-b1ddfb4afdf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:34.057149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 948/1893] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:34.074741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1336d72-0bed-41dc-8417-e0689eb33335 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:34.076522 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d1336d72-0bed-41dc-8417-e0689eb33335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:34.161711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c5ce5-b1c9-435a-b45e-b1ddfb4afdf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:34.163624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c5ce5-b1c9-435a-b45e-b1ddfb4afdf3 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:34.176520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 946/1894] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:34.193350 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c5ce5-b1c9-435a-b45e-b1ddfb4afdf3 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:34.203671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c5ce5-b1c9-435a-b45e-b1ddfb4afdf3 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:34.204011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1336d72-0bed-41dc-8417-e0689eb33335 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:34.210764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:34.211576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:34.211923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:34.212260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] PATH_INFO: `/v3/projects/726c7dbd53b04135936ce844d1302e25` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:34.213597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726c7dbd53b04135936ce844d1302e25)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:34.215874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:34.224196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0aa49-1280-4d51-84d1-8306dac801f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:34.227099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0aa49-1280-4d51-84d1-8306dac801f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:34.227378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0aa49-1280-4d51-84d1-8306dac801f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:34.227659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0aa49-1280-4d51-84d1-8306dac801f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:34.254984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0aa49-1280-4d51-84d1-8306dac801f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:34.256876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0aa49-1280-4d51-84d1-8306dac801f9 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:34.275922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 947/1895] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:34.278737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0aa49-1280-4d51-84d1-8306dac801f9 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:34.290689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0aa49-1280-4d51-84d1-8306dac801f9 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:34.295511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:34.296140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:34.296422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:34.296726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] PATH_INFO: `/v3/users/9ab17d9d56c34cf5b9b84f0175453d66` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:34.297916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab17d9d56c34cf5b9b84f0175453d66)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:34.300659 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:34.358603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726c7dbd53b04135936ce844d1302e25', 'request_id': 'req-92849421-9cad-4f49-8c38-76cdbb825891'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.426969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:34.427733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726c7dbd53b04135936ce844d1302e25', 'request_id': 'req-92849421-9cad-4f49-8c38-76cdbb825891'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.437261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726c7dbd53b04135936ce844d1302e25', 'request_id': 'req-92849421-9cad-4f49-8c38-76cdbb825891'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.454741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] The token cache is being invalidate because project 726c7dbd53b04135936ce844d1302e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:34.455151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.456352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.457861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 949/1896] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:34 2022] DELETE /identity/v3/projects/726c7dbd53b04135936ce844d1302e25 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:34.462509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:34.463917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:34.525671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab17d9d56c34cf5b9b84f0175453d66'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.543756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab17d9d56c34cf5b9b84f0175453d66'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.562736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92849421-9cad-4f49-8c38-76cdbb825891 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:34.567801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:34.568623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:34.569143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:34.569551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] PATH_INFO: `/v3/users/f5d53b48388848edb84e2bdd3b6a853b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:34.571141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d53b48388848edb84e2bdd3b6a853b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:34.574622 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:34.620236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab17d9d56c34cf5b9b84f0175453d66'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.620808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab17d9d56c34cf5b9b84f0175453d66'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.630665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bba7a1c0-6a8c-4801-a20b-1dc085803d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab17d9d56c34cf5b9b84f0175453d66'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.636982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 948/1897] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:34 2022] DELETE /identity/v3/users/9ab17d9d56c34cf5b9b84f0175453d66 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:34.641401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20e63-1200-4da9-af79-e3cd96b376a2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:34.642192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20e63-1200-4da9-af79-e3cd96b376a2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:34.644031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20e63-1200-4da9-af79-e3cd96b376a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:34.668630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-beb20e63-1200-4da9-af79-e3cd96b376a2 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:34.670020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-beb20e63-1200-4da9-af79-e3cd96b376a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:34.746223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 949/1898] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:34.757323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20e63-1200-4da9-af79-e3cd96b376a2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:34.758790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-beb20e63-1200-4da9-af79-e3cd96b376a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:34.819980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20e63-1200-4da9-af79-e3cd96b376a2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:34.824036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:34.824651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:34.824942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:34.825194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:34.838642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:34.840089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:34.856660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 950/1899] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:34.859991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d53b48388848edb84e2bdd3b6a853b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.860801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d53b48388848edb84e2bdd3b6a853b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.871074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d53b48388848edb84e2bdd3b6a853b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.885638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d53b48388848edb84e2bdd3b6a853b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:34.886472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d53b48388848edb84e2bdd3b6a853b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.089096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 950/1900] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:34 2022] DELETE /identity/v3/users/f5d53b48388848edb84e2bdd3b6a853b => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:35.182615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:35.184366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:35.203507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ae145-7255-4ed5-a779-298f135db87b service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:35.273685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:35.274802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:35.274802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:35.275000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] PATH_INFO: `/v3/users/db224ec7cce44bccb847e39486ca2956` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:35.276074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db224ec7cce44bccb847e39486ca2956)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:35.278060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:35.420402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:35.491730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db224ec7cce44bccb847e39486ca2956'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.505214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db224ec7cce44bccb847e39486ca2956'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.581881 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:35.585152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:35.603025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db224ec7cce44bccb847e39486ca2956'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.603978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db224ec7cce44bccb847e39486ca2956'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.606785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b8d04-5b4e-4683-9751-d6206fade9da admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:35.615956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-14b8955e-175c-452d-a6aa-c9d25315202f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db224ec7cce44bccb847e39486ca2956'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.616508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:35.617159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:35.617437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:35.617710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] PATH_INFO: `/v3/projects/37f7080b6e0742c39c0a29695fd90730` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:35.618942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f7080b6e0742c39c0a29695fd90730)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:35.620842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:35.623061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 951/1901] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:35 2022] DELETE /identity/v3/users/db224ec7cce44bccb847e39486ca2956 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:35.628045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3124-bd9f-4de3-9edd-3b4e6785c8a6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:35.628336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3124-bd9f-4de3-9edd-3b4e6785c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:35.628613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3124-bd9f-4de3-9edd-3b4e6785c8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:35.650788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-01ab3124-bd9f-4de3-9edd-3b4e6785c8a6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:35.652185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-01ab3124-bd9f-4de3-9edd-3b4e6785c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:35.735523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f7080b6e0742c39c0a29695fd90730', 'request_id': 'req-cd26581a-f5d5-4aa6-972b-669b407bcd4b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.771343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 952/1902] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:35.772271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab3124-bd9f-4de3-9edd-3b4e6785c8a6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:35.775458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-01ab3124-bd9f-4de3-9edd-3b4e6785c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:35.789252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab3124-bd9f-4de3-9edd-3b4e6785c8a6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:35.855556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f7080b6e0742c39c0a29695fd90730', 'request_id': 'req-cd26581a-f5d5-4aa6-972b-669b407bcd4b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.864387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f7080b6e0742c39c0a29695fd90730', 'request_id': 'req-cd26581a-f5d5-4aa6-972b-669b407bcd4b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.868238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:35.868893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:35.869169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:35.871148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] PATH_INFO: `/v3/projects/ab3653c349374e40b0645efad91d64a1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:35.872996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3653c349374e40b0645efad91d64a1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:35.874967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:35.889603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] The token cache is being invalidate because project 37f7080b6e0742c39c0a29695fd90730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:35.889603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.890242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:35.895846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 951/1903] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:35 2022] DELETE /identity/v3/projects/37f7080b6e0742c39c0a29695fd90730 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:35.896813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:35.898449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:35.972402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26581a-f5d5-4aa6-972b-669b407bcd4b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:35.977222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a323cf-74cc-48c5-9b96-a9a69beef79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:35.977895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a323cf-74cc-48c5-9b96-a9a69beef79e service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:35.978201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a323cf-74cc-48c5-9b96-a9a69beef79e service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:35.978480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a323cf-74cc-48c5-9b96-a9a69beef79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:35.980834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d0a323cf-74cc-48c5-9b96-a9a69beef79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:35.994256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a323cf-74cc-48c5-9b96-a9a69beef79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:35.995746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a323cf-74cc-48c5-9b96-a9a69beef79e service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:36.007023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 952/1904] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:36.008419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334890-2246-4522-a6d1-233073af0dcd None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.008722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334890-2246-4522-a6d1-233073af0dcd None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.008973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6334890-2246-4522-a6d1-233073af0dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.043832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f6334890-2246-4522-a6d1-233073af0dcd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:36.046159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f6334890-2246-4522-a6d1-233073af0dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:36.065461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 953/1905] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:36.073417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a0126-cb1f-4093-9b0f-c5797341e3a1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.074012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a0126-cb1f-4093-9b0f-c5797341e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.074741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a0126-cb1f-4093-9b0f-c5797341e3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.077676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3653c349374e40b0645efad91d64a1', 'request_id': 'req-74dc4ab3-2c38-4241-84a1-dddc98bd7998'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:36.115959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c17a0126-cb1f-4093-9b0f-c5797341e3a1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:36.117702 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c17a0126-cb1f-4093-9b0f-c5797341e3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:36.163336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3653c349374e40b0645efad91d64a1', 'request_id': 'req-74dc4ab3-2c38-4241-84a1-dddc98bd7998'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:36.172412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3653c349374e40b0645efad91d64a1', 'request_id': 'req-74dc4ab3-2c38-4241-84a1-dddc98bd7998'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:36.188649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] The token cache is being invalidate because project ab3653c349374e40b0645efad91d64a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:36.188947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:36.194574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-74dc4ab3-2c38-4241-84a1-dddc98bd7998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:36.197196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 953/1906] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:35 2022] DELETE /identity/v3/projects/ab3653c349374e40b0645efad91d64a1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:36.207846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abdc3-6201-486f-aad0-0c1b655e0e95 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.208193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abdc3-6201-486f-aad0-0c1b655e0e95 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.208477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510abdc3-6201-486f-aad0-0c1b655e0e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.243770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 954/1907] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:36.259015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-510abdc3-6201-486f-aad0-0c1b655e0e95 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:36.259493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a0126-cb1f-4093-9b0f-c5797341e3a1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:36.270346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-510abdc3-6201-486f-aad0-0c1b655e0e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:36.280809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a0126-cb1f-4093-9b0f-c5797341e3a1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:36.285272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 954/1908] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:36.293160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793017-ac77-4925-8b5f-f44faaad98d9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.293689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793017-ac77-4925-8b5f-f44faaad98d9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.294368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793017-ac77-4925-8b5f-f44faaad98d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.296014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:36.296648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.296926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.297196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.297857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:36.298232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:36.299997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:36.323276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6b793017-ac77-4925-8b5f-f44faaad98d9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:36.325437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6b793017-ac77-4925-8b5f-f44faaad98d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:36.335925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 955/1909] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:36.339149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:36.358879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7026a-2c9c-406d-9910-8c5ebf6e0802 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:36.369561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 955/1910] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:36.370196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ea01a-fd06-44a8-8ba1-0434f7b48fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:36.370844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ea01a-fd06-44a8-8ba1-0434f7b48fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.371093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ea01a-fd06-44a8-8ba1-0434f7b48fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.371365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ea01a-fd06-44a8-8ba1-0434f7b48fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.371685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793017-ac77-4925-8b5f-f44faaad98d9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:36.378521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ea01a-fd06-44a8-8ba1-0434f7b48fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:36.380494 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ea01a-fd06-44a8-8ba1-0434f7b48fc1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:36.426971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793017-ac77-4925-8b5f-f44faaad98d9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:36.441175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:36.441742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.442045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.442320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.442974 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:36.443276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:36.444902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:36.458542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 956/1911] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:36.462946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:36.477346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766eaee-f6f9-4e0a-9ed7-39c2a74374c8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:36.500232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 956/1912] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:36 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:36.505898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ea01a-fd06-44a8-8ba1-0434f7b48fc1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:36.508476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:36.509555 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.509836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.510156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.511289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:36.514993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:36.574033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ea01a-fd06-44a8-8ba1-0434f7b48fc1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:36.579012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf189618-3ed8-44b0-90fd-553c0cdcd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:36.579726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf189618-3ed8-44b0-90fd-553c0cdcd084 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.580083 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf189618-3ed8-44b0-90fd-553c0cdcd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.580960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf189618-3ed8-44b0-90fd-553c0cdcd084 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.581398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf189618-3ed8-44b0-90fd-553c0cdcd084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:36.583391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf189618-3ed8-44b0-90fd-553c0cdcd084 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:36.640829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 957/1913] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:36 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:36.642529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:36.652808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:36.670210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:36.711970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 957/1914] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:36 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:36.716212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf189618-3ed8-44b0-90fd-553c0cdcd084 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:36.730463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf189618-3ed8-44b0-90fd-553c0cdcd084 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:36.789136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6e615-f2f8-44a5-9f75-6f83e4f8c67a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:36.794878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:36.795586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.795866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.796145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] PATH_INFO: `/v3/projects/9f61d924502b4a6bb4667068676d823a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.797426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f61d924502b4a6bb4667068676d823a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:36.802893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:36.829007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a3631-3dbf-44e8-9f38-fe24dffe2624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:36.830268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a3631-3dbf-44e8-9f38-fe24dffe2624 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:36.830552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a3631-3dbf-44e8-9f38-fe24dffe2624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:36.830897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a3631-3dbf-44e8-9f38-fe24dffe2624 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:36.831659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a3631-3dbf-44e8-9f38-fe24dffe2624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:36.833720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a3631-3dbf-44e8-9f38-fe24dffe2624 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:36.943930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 958/1915] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:36 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:36.943930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a3631-3dbf-44e8-9f38-fe24dffe2624 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:36.961513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a3631-3dbf-44e8-9f38-fe24dffe2624 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:36.981687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f61d924502b4a6bb4667068676d823a', 'request_id': 'req-ee9135c7-5d93-40af-804e-a23dd1b89012'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.035786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:37.036457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.036741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.037016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.037669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:37.039307 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:37.049169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 959/1916] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:37.050573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.052208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:37.100441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f61d924502b4a6bb4667068676d823a', 'request_id': 'req-ee9135c7-5d93-40af-804e-a23dd1b89012'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.107015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f61d924502b4a6bb4667068676d823a', 'request_id': 'req-ee9135c7-5d93-40af-804e-a23dd1b89012'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.113825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d49719-d339-46a6-8351-3f813fa3c246 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:37.119832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:37.120452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.120728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.120999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.121468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] The token cache is being invalidate because project 9f61d924502b4a6bb4667068676d823a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:37.121707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.122410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.124053 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 958/1917] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:36 2022] DELETE /identity/v3/projects/9f61d924502b4a6bb4667068676d823a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:37.124825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.127170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:37.129221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:37.143140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9135c7-5d93-40af-804e-a23dd1b89012 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:37.148672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:37.150034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.150034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.150034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.150865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:37.152466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:37.164142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 959/1918] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:37.168068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.170080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:37.184004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520afbf-d7be-4d2d-b493-8c442424a678 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:37.189896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1a9c-c27b-419e-a770-3e9a56a5ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:37.190608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1a9c-c27b-419e-a770-3e9a56a5ff2c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.190894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1a9c-c27b-419e-a770-3e9a56a5ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.191281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b1a9c-c27b-419e-a770-3e9a56a5ff2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.191807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b1a9c-c27b-419e-a770-3e9a56a5ff2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:37.192241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:37.193437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b1a9c-c27b-419e-a770-3e9a56a5ff2c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:37.193759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:37.204386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 960/1919] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:37.205223 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.215587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:37.216088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 960/1920] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:37.216088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1a9c-c27b-419e-a770-3e9a56a5ff2c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.225780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd234f4-84c8-438d-80e3-88e0e07facd5 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:37.226549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b1a9c-c27b-419e-a770-3e9a56a5ff2c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:37.234374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:37.235028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.235310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.235586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] PATH_INFO: `/v3/users/366d28fc493248bbab90dd10d2120c6f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.236724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366d28fc493248bbab90dd10d2120c6f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:37.241277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:37.241410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10afaf-da32-4598-adf9-e70ee9702780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:37.244402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10afaf-da32-4598-adf9-e70ee9702780 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.244402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10afaf-da32-4598-adf9-e70ee9702780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.244402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10afaf-da32-4598-adf9-e70ee9702780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.244402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10afaf-da32-4598-adf9-e70ee9702780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:37.244753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10afaf-da32-4598-adf9-e70ee9702780 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:37.261288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 961/1921] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:37.262277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10afaf-da32-4598-adf9-e70ee9702780 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.276713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10afaf-da32-4598-adf9-e70ee9702780 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:37.283360 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847860d9-5dfb-4fbc-9838-d2f4a12c5a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:37.284714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847860d9-5dfb-4fbc-9838-d2f4a12c5a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.285002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847860d9-5dfb-4fbc-9838-d2f4a12c5a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.288139 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847860d9-5dfb-4fbc-9838-d2f4a12c5a8f admin admin] PATH_INFO: `/v3/projects/ef8e3b942bc3451a85641547f0ceb1f5/users/ee5cb9f3752c450c823f26ede744976b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.308031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847860d9-5dfb-4fbc-9838-d2f4a12c5a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8e3b942bc3451a85641547f0ceb1f5, user_id=ee5cb9f3752c450c823f26ede744976b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:37.308031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847860d9-5dfb-4fbc-9838-d2f4a12c5a8f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:37.490247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 962/1922] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:37 2022] PUT /identity/v3/projects/ef8e3b942bc3451a85641547f0ceb1f5/users/ee5cb9f3752c450c823f26ede744976b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:37.498252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847860d9-5dfb-4fbc-9838-d2f4a12c5a8f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.577876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847860d9-5dfb-4fbc-9838-d2f4a12c5a8f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:37.583224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11812ba0-b237-4a2a-b9a3-033f5d95294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:37.583890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11812ba0-b237-4a2a-b9a3-033f5d95294a admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.584480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11812ba0-b237-4a2a-b9a3-033f5d95294a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.584760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11812ba0-b237-4a2a-b9a3-033f5d95294a admin admin] PATH_INFO: `/v3/projects/43082004b3384595808e678043860e17/users/8ddba5d7b5ff4735b9e6a961555498f2/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.601837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11812ba0-b237-4a2a-b9a3-033f5d95294a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43082004b3384595808e678043860e17, user_id=8ddba5d7b5ff4735b9e6a961555498f2, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:37.606149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11812ba0-b237-4a2a-b9a3-033f5d95294a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:37.611204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366d28fc493248bbab90dd10d2120c6f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.612208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366d28fc493248bbab90dd10d2120c6f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.621756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366d28fc493248bbab90dd10d2120c6f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.635733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366d28fc493248bbab90dd10d2120c6f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.636545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8dc59626-6af6-4554-8071-cfaf81f02588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366d28fc493248bbab90dd10d2120c6f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:37.736227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 963/1923] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:37 2022] PUT /identity/v3/projects/43082004b3384595808e678043860e17/users/8ddba5d7b5ff4735b9e6a961555498f2/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:37.746488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f52b-a0db-4a19-b218-0671d9573e90 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.746742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f52b-a0db-4a19-b218-0671d9573e90 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.746976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032f52b-a0db-4a19-b218-0671d9573e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.757264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 961/1924] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:37 2022] DELETE /identity/v3/users/366d28fc493248bbab90dd10d2120c6f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:37.761365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545eb7-08f5-477e-b5e4-13bda7e16b19 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:37.761651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545eb7-08f5-477e-b5e4-13bda7e16b19 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:37.761932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545eb7-08f5-477e-b5e4-13bda7e16b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:37.806065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d032f52b-a0db-4a19-b218-0671d9573e90 None None] MFA Rules not processed for user `ee5cb9f3752c450c823f26ede744976b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:37.807852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d032f52b-a0db-4a19-b218-0671d9573e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:37.828218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6f545eb7-08f5-477e-b5e4-13bda7e16b19 None None] MFA Rules not processed for user `8ddba5d7b5ff4735b9e6a961555498f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:37.829855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6f545eb7-08f5-477e-b5e4-13bda7e16b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:37.902274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 964/1925] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:37.907946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032f52b-a0db-4a19-b218-0671d9573e90 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.909688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d032f52b-a0db-4a19-b218-0671d9573e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:37.954381 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 962/1926] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:37.960043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f545eb7-08f5-477e-b5e4-13bda7e16b19 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:37.961785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6f545eb7-08f5-477e-b5e4-13bda7e16b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:38.067880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032f52b-a0db-4a19-b218-0671d9573e90 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.069993 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f545eb7-08f5-477e-b5e4-13bda7e16b19 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.076656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f1df-999d-4462-9e64-7fec1bb5c778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:38.077135 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29dab-9b8c-4f79-a4d7-d5ade943a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:38.077465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f1df-999d-4462-9e64-7fec1bb5c778 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:38.077837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f1df-999d-4462-9e64-7fec1bb5c778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:38.078205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f1df-999d-4462-9e64-7fec1bb5c778 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:38.078651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29dab-9b8c-4f79-a4d7-d5ade943a3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:38.079049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402f1df-999d-4462-9e64-7fec1bb5c778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:38.080303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29dab-9b8c-4f79-a4d7-d5ade943a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:38.080810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b29dab-9b8c-4f79-a4d7-d5ade943a3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:38.081865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b29dab-9b8c-4f79-a4d7-d5ade943a3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:38.085032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b29dab-9b8c-4f79-a4d7-d5ade943a3b9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:38.087446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402f1df-999d-4462-9e64-7fec1bb5c778 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:38.274647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 965/1927] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:37 2022] POST /identity/v3/projects => generated 383 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:38.282224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f1df-999d-4462-9e64-7fec1bb5c778 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:38.286573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 963/1928] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:37 2022] POST /identity/v3/projects => generated 383 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:38.287726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29dab-9b8c-4f79-a4d7-d5ade943a3b9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:38.398308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f1df-999d-4462-9e64-7fec1bb5c778 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.403068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114291c6-e6b0-478c-9c6c-31c29369a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:38.423458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114291c6-e6b0-478c-9c6c-31c29369a2ba admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:38.423458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114291c6-e6b0-478c-9c6c-31c29369a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:38.423458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114291c6-e6b0-478c-9c6c-31c29369a2ba admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:38.423458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114291c6-e6b0-478c-9c6c-31c29369a2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:38.423859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b29dab-9b8c-4f79-a4d7-d5ade943a3b9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.423958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114291c6-e6b0-478c-9c6c-31c29369a2ba admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:38.424056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:38.424056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:38.424056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:38.424056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:38.424372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:38.424372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:38.564852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 964/1929] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:38 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:38.566037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:38.568095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:38.569935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 966/1930] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:38 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:38.582717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114291c6-e6b0-478c-9c6c-31c29369a2ba admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:38.585590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd884-679d-4b62-bd61-173d88f97ddb admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.593068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:38.593720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:38.594048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:38.594431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] PATH_INFO: `/v3/projects/06fc082cfdc94f9c92f2668829ab6de1` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:38.597429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] RBAC: Authorizing `identity:delete_project(project_id=06fc082cfdc94f9c92f2668829ab6de1)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:38.601074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:38.608440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114291c6-e6b0-478c-9c6c-31c29369a2ba admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.621425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e15e5-3637-48ea-9565-c59896f31a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:38.622078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e15e5-3637-48ea-9565-c59896f31a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:38.622363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e15e5-3637-48ea-9565-c59896f31a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:38.622638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e15e5-3637-48ea-9565-c59896f31a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:38.623283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e15e5-3637-48ea-9565-c59896f31a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:38.624883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e15e5-3637-48ea-9565-c59896f31a2d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:38.658368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 967/1931] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:38.665261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e15e5-3637-48ea-9565-c59896f31a2d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:38.683665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e15e5-3637-48ea-9565-c59896f31a2d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.696506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c12a8-181b-41b9-88a9-842c1caf97ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:38.699437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c12a8-181b-41b9-88a9-842c1caf97ed admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:38.707207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c12a8-181b-41b9-88a9-842c1caf97ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:38.707207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c12a8-181b-41b9-88a9-842c1caf97ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:38.707207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c12a8-181b-41b9-88a9-842c1caf97ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:38.707207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c12a8-181b-41b9-88a9-842c1caf97ed admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:38.719616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 968/1932] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:38.723363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c12a8-181b-41b9-88a9-842c1caf97ed admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:38.742025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c12a8-181b-41b9-88a9-842c1caf97ed admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.749779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d46bf-1601-4123-a40b-c12dced72fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:38.753611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d46bf-1601-4123-a40b-c12dced72fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:38.753611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d46bf-1601-4123-a40b-c12dced72fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:38.753611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d46bf-1601-4123-a40b-c12dced72fd7 admin admin] PATH_INFO: `/v3/projects/d962400e302d4fe0a1836336ccad40f6/users/b11f682a4ead488890a836a4a1bdc9e1/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:38.775800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d46bf-1601-4123-a40b-c12dced72fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d962400e302d4fe0a1836336ccad40f6, user_id=b11f682a4ead488890a836a4a1bdc9e1, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:38.781956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d46bf-1601-4123-a40b-c12dced72fd7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:38.898618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 969/1933] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:38 2022] PUT /identity/v3/projects/d962400e302d4fe0a1836336ccad40f6/users/b11f682a4ead488890a836a4a1bdc9e1/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:38.902579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d46bf-1601-4123-a40b-c12dced72fd7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:38.910265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06fc082cfdc94f9c92f2668829ab6de1', 'request_id': 'req-ea554a7c-c5dd-4c4d-b64d-66a024affadd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:38.973857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d46bf-1601-4123-a40b-c12dced72fd7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:38.997336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06fc082cfdc94f9c92f2668829ab6de1', 'request_id': 'req-ea554a7c-c5dd-4c4d-b64d-66a024affadd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:39.007554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06fc082cfdc94f9c92f2668829ab6de1', 'request_id': 'req-ea554a7c-c5dd-4c4d-b64d-66a024affadd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:39.023145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] The token cache is being invalidate because project 06fc082cfdc94f9c92f2668829ab6de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:39.023653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:39.024412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:39.029827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 965/1934] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:38 2022] DELETE /identity/v3/projects/06fc082cfdc94f9c92f2668829ab6de1 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:39.030659 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:39.032209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:39.061239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc6c45-c030-4e08-97e2-62304c9c4a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.061862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6c45-c030-4e08-97e2-62304c9c4a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.062189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6c45-c030-4e08-97e2-62304c9c4a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.062467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6c45-c030-4e08-97e2-62304c9c4a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.063118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc6c45-c030-4e08-97e2-62304c9c4a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.064711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc6c45-c030-4e08-97e2-62304c9c4a76 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.075842 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 970/1935] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:39.078568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2bc2-c48f-40fa-ad6e-d087f754d112 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.078568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2bc2-c48f-40fa-ad6e-d087f754d112 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.078568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2bc2-c48f-40fa-ad6e-d087f754d112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.099084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b52a2bc2-c48f-40fa-ad6e-d087f754d112 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:39.101467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b52a2bc2-c48f-40fa-ad6e-d087f754d112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:39.105935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea554a7c-c5dd-4c4d-b64d-66a024affadd admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:39.109944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 971/1936] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:39.110736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e05b1-ab30-4723-894e-8e83c045799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.111361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e05b1-ab30-4723-894e-8e83c045799f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.111639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e05b1-ab30-4723-894e-8e83c045799f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.112414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e05b1-ab30-4723-894e-8e83c045799f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.113512 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e05b1-ab30-4723-894e-8e83c045799f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.114842 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a2bc2-c48f-40fa-ad6e-d087f754d112 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:39.115144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e05b1-ab30-4723-894e-8e83c045799f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.117256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b52a2bc2-c48f-40fa-ad6e-d087f754d112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:39.132600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a2bc2-c48f-40fa-ad6e-d087f754d112 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:39.138711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d128c-3e31-493f-9794-35661e80ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.139458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d128c-3e31-493f-9794-35661e80ae53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.139748 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d128c-3e31-493f-9794-35661e80ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.140030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d128c-3e31-493f-9794-35661e80ae53 admin admin] PATH_INFO: `/v3/projects/9254cc9a35db457e9434c87bd55d13d0/users/e1663a4be64a4402b395f30dc627acdc/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.144980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 966/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:39.147928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04182787-6f8d-4388-8d3a-14c31c2aa678 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.148267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04182787-6f8d-4388-8d3a-14c31c2aa678 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.148550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04182787-6f8d-4388-8d3a-14c31c2aa678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.158507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d128c-3e31-493f-9794-35661e80ae53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9254cc9a35db457e9434c87bd55d13d0, user_id=e1663a4be64a4402b395f30dc627acdc, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.162507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d128c-3e31-493f-9794-35661e80ae53 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.180013 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-04182787-6f8d-4388-8d3a-14c31c2aa678 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:39.181322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-04182787-6f8d-4388-8d3a-14c31c2aa678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:39.192364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 967/1938] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:39.196057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04182787-6f8d-4388-8d3a-14c31c2aa678 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:39.203495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04182787-6f8d-4388-8d3a-14c31c2aa678 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:39.209314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb1544-512f-4dad-918a-6d7c4448b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.210616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1544-512f-4dad-918a-6d7c4448b0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.210616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1544-512f-4dad-918a-6d7c4448b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.210616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb1544-512f-4dad-918a-6d7c4448b0a2 admin admin] PATH_INFO: `/v3/projects/d962400e302d4fe0a1836336ccad40f6/users/b11f682a4ead488890a836a4a1bdc9e1/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.212620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb1544-512f-4dad-918a-6d7c4448b0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d962400e302d4fe0a1836336ccad40f6, user_id=b11f682a4ead488890a836a4a1bdc9e1, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.215406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb1544-512f-4dad-918a-6d7c4448b0a2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.228839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 968/1939] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:39 2022] PUT /identity/v3/projects/d962400e302d4fe0a1836336ccad40f6/users/b11f682a4ead488890a836a4a1bdc9e1/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:39.228839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb1544-512f-4dad-918a-6d7c4448b0a2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:39.268396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 972/1940] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:39 2022] PUT /identity/v3/projects/9254cc9a35db457e9434c87bd55d13d0/users/e1663a4be64a4402b395f30dc627acdc/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:39.270021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d614-78ef-494e-9bff-7c9ac74578ce None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.270154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d614-78ef-494e-9bff-7c9ac74578ce None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.270520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d614-78ef-494e-9bff-7c9ac74578ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.316424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-26e9d614-78ef-494e-9bff-7c9ac74578ce None None] MFA Rules not processed for user `b11f682a4ead488890a836a4a1bdc9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:39.317643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-26e9d614-78ef-494e-9bff-7c9ac74578ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:39.347975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb1544-512f-4dad-918a-6d7c4448b0a2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:39.444503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.445606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.445892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.446287 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.449003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:39.449402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.451097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 973/1941] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:39.453547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742b6ea-e700-4ec2-b2b1-b56227591f9d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.454195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742b6ea-e700-4ec2-b2b1-b56227591f9d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.458311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742b6ea-e700-4ec2-b2b1-b56227591f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.458664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.485903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 969/1942] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:39.487025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:39.498798 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c742b6ea-e700-4ec2-b2b1-b56227591f9d None None] MFA Rules not processed for user `e1663a4be64a4402b395f30dc627acdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:39.500433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c742b6ea-e700-4ec2-b2b1-b56227591f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:39.522339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5753b-060a-4d8e-9624-7de3b94e2685 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:39.538275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81291ff0-e0f1-4e95-8fb4-7ece7f22830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.538910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81291ff0-e0f1-4e95-8fb4-7ece7f22830b admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.539801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81291ff0-e0f1-4e95-8fb4-7ece7f22830b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.542558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81291ff0-e0f1-4e95-8fb4-7ece7f22830b admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.543665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81291ff0-e0f1-4e95-8fb4-7ece7f22830b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.547208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81291ff0-e0f1-4e95-8fb4-7ece7f22830b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.613778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 974/1943] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:39.615012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742b6ea-e700-4ec2-b2b1-b56227591f9d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:39.616725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c742b6ea-e700-4ec2-b2b1-b56227591f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:39.656469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:39.693795 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 970/1944] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:39 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:39.694017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742b6ea-e700-4ec2-b2b1-b56227591f9d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:39.694754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81291ff0-e0f1-4e95-8fb4-7ece7f22830b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:39.747597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.748315 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.748667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.749003 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.751135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:39.753963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:39.779150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81291ff0-e0f1-4e95-8fb4-7ece7f22830b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:39.785815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56fc19-f159-4221-97a9-69a169b4fcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.786688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56fc19-f159-4221-97a9-69a169b4fcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.787018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56fc19-f159-4221-97a9-69a169b4fcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.788133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56fc19-f159-4221-97a9-69a169b4fcb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.789209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56fc19-f159-4221-97a9-69a169b4fcb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.791462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56fc19-f159-4221-97a9-69a169b4fcb4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.818413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.819852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.829965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 975/1945] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:39.831790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:39.845145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e703b-78f9-4532-8278-2a7d5ace933c service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:39.868941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87d296-89e7-40d8-a3b2-8e89e679da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:39.869585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d296-89e7-40d8-a3b2-8e89e679da24 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:39.869869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d296-89e7-40d8-a3b2-8e89e679da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:39.870173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d296-89e7-40d8-a3b2-8e89e679da24 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:39.870827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87d296-89e7-40d8-a3b2-8e89e679da24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:39.872767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87d296-89e7-40d8-a3b2-8e89e679da24 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:39.920404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 971/1946] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:39 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:39.924540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56fc19-f159-4221-97a9-69a169b4fcb4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.032818 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 976/1947] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:39 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:40.034103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56fc19-f159-4221-97a9-69a169b4fcb4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.037011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87d296-89e7-40d8-a3b2-8e89e679da24 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.048979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bacdff-c677-454f-bfc0-2e799f9b9a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.052539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bacdff-c677-454f-bfc0-2e799f9b9a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.052539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bacdff-c677-454f-bfc0-2e799f9b9a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.052539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bacdff-c677-454f-bfc0-2e799f9b9a8f admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.052539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bacdff-c677-454f-bfc0-2e799f9b9a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.054793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87d296-89e7-40d8-a3b2-8e89e679da24 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.057176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bacdff-c677-454f-bfc0-2e799f9b9a8f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.070673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25051b8f-0a91-4154-96a8-a549dcc5d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.071630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051b8f-0a91-4154-96a8-a549dcc5d669 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.072126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051b8f-0a91-4154-96a8-a549dcc5d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.072708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051b8f-0a91-4154-96a8-a549dcc5d669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.073548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25051b8f-0a91-4154-96a8-a549dcc5d669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.075377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25051b8f-0a91-4154-96a8-a549dcc5d669 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.092737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 977/1948] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:40:40.097001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25051b8f-0a91-4154-96a8-a549dcc5d669 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.115027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25051b8f-0a91-4154-96a8-a549dcc5d669 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.137518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756fc7e-0c72-4af3-a382-b3be0607e524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.138333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756fc7e-0c72-4af3-a382-b3be0607e524 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.138620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756fc7e-0c72-4af3-a382-b3be0607e524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.138913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756fc7e-0c72-4af3-a382-b3be0607e524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.139584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756fc7e-0c72-4af3-a382-b3be0607e524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.145200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756fc7e-0c72-4af3-a382-b3be0607e524 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.166869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 978/1949] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:40.174579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756fc7e-0c72-4af3-a382-b3be0607e524 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.194692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 972/1950] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:39 2022] POST /identity/v3/users => generated 299 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:40.199698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bacdff-c677-454f-bfc0-2e799f9b9a8f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.204510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756fc7e-0c72-4af3-a382-b3be0607e524 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.218420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bacdff-c677-454f-bfc0-2e799f9b9a8f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.221045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d44d04-660c-4966-80c2-3e7a0f918738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.222303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d44d04-660c-4966-80c2-3e7a0f918738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.222665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d44d04-660c-4966-80c2-3e7a0f918738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.223010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d44d04-660c-4966-80c2-3e7a0f918738 admin admin] PATH_INFO: `/v3/projects/f4f19f68be374b2e9c6da63626065a41/users/c4e9ff3903794eae94593d0f038d50b4/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.245867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d30840-326d-442f-ac43-1f6e93c112e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.253238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30840-326d-442f-ac43-1f6e93c112e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.253238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30840-326d-442f-ac43-1f6e93c112e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.253238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30840-326d-442f-ac43-1f6e93c112e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.253238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d30840-326d-442f-ac43-1f6e93c112e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.253238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d30840-326d-442f-ac43-1f6e93c112e4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.272494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d44d04-660c-4966-80c2-3e7a0f918738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f19f68be374b2e9c6da63626065a41, user_id=c4e9ff3903794eae94593d0f038d50b4, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.286136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d44d04-660c-4966-80c2-3e7a0f918738 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.291439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 973/1951] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:40.298931 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d30840-326d-442f-ac43-1f6e93c112e4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.321990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d30840-326d-442f-ac43-1f6e93c112e4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.335212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94d187-f3fb-4eb8-9c65-876fc1df52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.335902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94d187-f3fb-4eb8-9c65-876fc1df52c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.355217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94d187-f3fb-4eb8-9c65-876fc1df52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.355217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94d187-f3fb-4eb8-9c65-876fc1df52c4 admin admin] PATH_INFO: `/v3/projects/eec2ffc1eae14e4583aa004548fd8c23/users/ecd75118d6d3477380b72603c1cee629/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.368618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94d187-f3fb-4eb8-9c65-876fc1df52c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec2ffc1eae14e4583aa004548fd8c23, user_id=ecd75118d6d3477380b72603c1cee629, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.368982 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94d187-f3fb-4eb8-9c65-876fc1df52c4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.471300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 979/1952] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:40 2022] PUT /identity/v3/projects/f4f19f68be374b2e9c6da63626065a41/users/c4e9ff3903794eae94593d0f038d50b4/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:40.491304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401cb3e-b5d6-44b3-9478-637eb9d69c27 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.491766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401cb3e-b5d6-44b3-9478-637eb9d69c27 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.492141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401cb3e-b5d6-44b3-9478-637eb9d69c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.519832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 974/1953] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:40 2022] PUT /identity/v3/projects/eec2ffc1eae14e4583aa004548fd8c23/users/ecd75118d6d3477380b72603c1cee629/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:40.521197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94d187-f3fb-4eb8-9c65-876fc1df52c4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.557135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7401cb3e-b5d6-44b3-9478-637eb9d69c27 None None] MFA Rules not processed for user `c4e9ff3903794eae94593d0f038d50b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:40.558929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7401cb3e-b5d6-44b3-9478-637eb9d69c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:40.677657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94d187-f3fb-4eb8-9c65-876fc1df52c4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.684643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3d15c-a1f1-46e5-8dbf-ebefdf42432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.685558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d15c-a1f1-46e5-8dbf-ebefdf42432e admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.686128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d15c-a1f1-46e5-8dbf-ebefdf42432e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.686716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3d15c-a1f1-46e5-8dbf-ebefdf42432e admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.687505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3d15c-a1f1-46e5-8dbf-ebefdf42432e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.689546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3d15c-a1f1-46e5-8dbf-ebefdf42432e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.722021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 980/1954] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:40.722327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 975/1955] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:40.723103 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401cb3e-b5d6-44b3-9478-637eb9d69c27 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.723775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3d15c-a1f1-46e5-8dbf-ebefdf42432e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:40.743937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3d15c-a1f1-46e5-8dbf-ebefdf42432e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.749126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401cb3e-b5d6-44b3-9478-637eb9d69c27 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:40.751245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1651889-8cd3-4e92-837c-757826b8f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.752364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1651889-8cd3-4e92-837c-757826b8f5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.752880 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1651889-8cd3-4e92-837c-757826b8f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.753161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1651889-8cd3-4e92-837c-757826b8f5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.753835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1651889-8cd3-4e92-837c-757826b8f5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.756134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1651889-8cd3-4e92-837c-757826b8f5e4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.770127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cb075-ce88-47f2-9e27-4a5a8d0c035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:40.771486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cb075-ce88-47f2-9e27-4a5a8d0c035d admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.771739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cb075-ce88-47f2-9e27-4a5a8d0c035d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.772016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cb075-ce88-47f2-9e27-4a5a8d0c035d admin admin] PATH_INFO: `/v3/projects/eec2ffc1eae14e4583aa004548fd8c23/users/ecd75118d6d3477380b72603c1cee629/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.777212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cb075-ce88-47f2-9e27-4a5a8d0c035d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec2ffc1eae14e4583aa004548fd8c23, user_id=ecd75118d6d3477380b72603c1cee629, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:40.786488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cb075-ce88-47f2-9e27-4a5a8d0c035d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:40.812559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 981/1956] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:40 2022] PUT /identity/v3/projects/eec2ffc1eae14e4583aa004548fd8c23/users/ecd75118d6d3477380b72603c1cee629/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:40.824949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8483f-bef4-4082-8176-f5ce2192039a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:40.826970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8483f-bef4-4082-8176-f5ce2192039a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:40.826970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8483f-bef4-4082-8176-f5ce2192039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:40.865177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-dba8483f-bef4-4082-8176-f5ce2192039a None None] MFA Rules not processed for user `ecd75118d6d3477380b72603c1cee629`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:40.866490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dba8483f-bef4-4082-8176-f5ce2192039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:40.992689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 976/1957] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:40 2022] POST /identity/v3/projects => generated 387 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:40.996689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1651889-8cd3-4e92-837c-757826b8f5e4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:41.061856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 982/1958] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:41.151759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1651889-8cd3-4e92-837c-757826b8f5e4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:41.156638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6704c8-4488-43a5-903c-ee3f50d6fe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:41.157281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6704c8-4488-43a5-903c-ee3f50d6fe51 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:41.157562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6704c8-4488-43a5-903c-ee3f50d6fe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:41.157837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6704c8-4488-43a5-903c-ee3f50d6fe51 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:41.158504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6704c8-4488-43a5-903c-ee3f50d6fe51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:41.161469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6704c8-4488-43a5-903c-ee3f50d6fe51 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:41.352998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 977/1959] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:40 2022] POST /identity/v3/users => generated 300 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:41.359182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8483f-bef4-4082-8176-f5ce2192039a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:41.390723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6704c8-4488-43a5-903c-ee3f50d6fe51 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:41.498114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8483f-bef4-4082-8176-f5ce2192039a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:41.506876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6704c8-4488-43a5-903c-ee3f50d6fe51 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:41.509012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6d486-ba38-4cf7-9291-79f186812c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:41.510045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d486-ba38-4cf7-9291-79f186812c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:41.510414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d486-ba38-4cf7-9291-79f186812c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:41.510695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d486-ba38-4cf7-9291-79f186812c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:41.511472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6d486-ba38-4cf7-9291-79f186812c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:41.513338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6d486-ba38-4cf7-9291-79f186812c34 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:41.514258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:41.515708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:41.516253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:41.516755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:41.520490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:41.528912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 983/1960] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:41.541461 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6d486-ba38-4cf7-9291-79f186812c34 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:41.545954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6d486-ba38-4cf7-9291-79f186812c34 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:41.550953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19b90-fc78-404e-9071-3fe97fc0cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:41.551647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19b90-fc78-404e-9071-3fe97fc0cef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:41.552078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19b90-fc78-404e-9071-3fe97fc0cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:41.552362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19b90-fc78-404e-9071-3fe97fc0cef7 admin admin] PATH_INFO: `/v3/projects/90e8246b5c354d6abde2583662e69fdf/users/7afc33170bb242f8a723ff084988be45/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:41.569304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f19b90-fc78-404e-9071-3fe97fc0cef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e8246b5c354d6abde2583662e69fdf, user_id=7afc33170bb242f8a723ff084988be45, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:41.572640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f19b90-fc78-404e-9071-3fe97fc0cef7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:41.594406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:41.596078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:41.605779 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 978/1961] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:41.660673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 984/1962] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:41 2022] PUT /identity/v3/projects/90e8246b5c354d6abde2583662e69fdf/users/7afc33170bb242f8a723ff084988be45/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:41.664814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:41.676230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717941c-a5f4-489b-985b-ca12464da03f service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:41.735055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be89603-b145-4e96-a07e-9d2b1a1d1d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:41.735716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89603-b145-4e96-a07e-9d2b1a1d1d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:41.735999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89603-b145-4e96-a07e-9d2b1a1d1d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:41.736270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be89603-b145-4e96-a07e-9d2b1a1d1d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:41.737014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be89603-b145-4e96-a07e-9d2b1a1d1d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:41.738842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be89603-b145-4e96-a07e-9d2b1a1d1d39 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:41.748875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 979/1963] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:41.754044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19b90-fc78-404e-9071-3fe97fc0cef7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:41.765153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19b90-fc78-404e-9071-3fe97fc0cef7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:41.771447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:41.772169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:41.772456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:41.772728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] PATH_INFO: `/v3/projects/90e8246b5c354d6abde2583662e69fdf/users/7afc33170bb242f8a723ff084988be45/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:41.774700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e8246b5c354d6abde2583662e69fdf, user_id=7afc33170bb242f8a723ff084988be45, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:41.777417 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:41.788243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 985/1964] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:41 2022] PUT /identity/v3/projects/90e8246b5c354d6abde2583662e69fdf/users/7afc33170bb242f8a723ff084988be45/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:41.807991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133eaa-daf6-4b60-be79-1ed8cb7f8a84 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:41.808262 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133eaa-daf6-4b60-be79-1ed8cb7f8a84 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:41.809161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133eaa-daf6-4b60-be79-1ed8cb7f8a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:41.840705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d0133eaa-daf6-4b60-be79-1ed8cb7f8a84 None None] MFA Rules not processed for user `7afc33170bb242f8a723ff084988be45`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:41.842024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d0133eaa-daf6-4b60-be79-1ed8cb7f8a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:41.915733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 980/1965] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:42.176071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:42.243004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:42.384730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:42.388294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:42.465605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19685bd-5f8a-45d5-aaf7-5cb4ca97a467 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:42.478713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc325361-3e39-4066-8b3f-b3c97765d37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:42.479623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc325361-3e39-4066-8b3f-b3c97765d37e service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:42.479623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc325361-3e39-4066-8b3f-b3c97765d37e service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:42.481902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc325361-3e39-4066-8b3f-b3c97765d37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:42.491570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc325361-3e39-4066-8b3f-b3c97765d37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:42.493100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc325361-3e39-4066-8b3f-b3c97765d37e service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:42.504994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 986/1966] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:43.244273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133eaa-daf6-4b60-be79-1ed8cb7f8a84 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:43.309675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133eaa-daf6-4b60-be79-1ed8cb7f8a84 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:43.314389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:43.315030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:43.316204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:43.316322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] PATH_INFO: `/v3/users/c4e9ff3903794eae94593d0f038d50b4` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:43.318045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e9ff3903794eae94593d0f038d50b4)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:43.319988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:43.618109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e9ff3903794eae94593d0f038d50b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:43.618818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e9ff3903794eae94593d0f038d50b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:43.626240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e9ff3903794eae94593d0f038d50b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:43.644543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e9ff3903794eae94593d0f038d50b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:43.645733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e9ff3903794eae94593d0f038d50b4'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:43.792625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 981/1967] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:43 2022] DELETE /identity/v3/users/c4e9ff3903794eae94593d0f038d50b4 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:43.801303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409201-aea6-4853-87b5-c81710782a73 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:43.801303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409201-aea6-4853-87b5-c81710782a73 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:43.801303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409201-aea6-4853-87b5-c81710782a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:43.819613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9b409201-aea6-4853-87b5-c81710782a73 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:43.823387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9b409201-aea6-4853-87b5-c81710782a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:43.835665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:43.835665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:43.896744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5b64e-816c-40bc-8910-4ce356effbea admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:43.897460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 987/1968] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:43.901208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:43.901829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:43.902300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:43.902743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:43.905802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:43.907955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b409201-aea6-4853-87b5-c81710782a73 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:43.910053 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9b409201-aea6-4853-87b5-c81710782a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:43.972274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b409201-aea6-4853-87b5-c81710782a73 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:43.974074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:43.975524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:43.976021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:43.976612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:43.976889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:43.977161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:43.984352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 982/1969] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:43.986640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:43.988688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:43.999506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 988/1970] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:44.283465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:44.352567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:44.439493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:44.441457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:44.458914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc744947-4de7-440c-a418-1dfaba90d8d3 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:44.466331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:44.472202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:44.472202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:44.472202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] PATH_INFO: `/v3/users/23201bf82ef340329668c950d3be2f5f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:44.472202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=23201bf82ef340329668c950d3be2f5f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:44.472202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:44.647939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:44.649423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:44.662893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f85e-ca87-4e07-b65e-ccf5d0fb1cd8 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:44.669149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:44.669844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:44.670330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:44.670816 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] PATH_INFO: `/v3/projects/f4f19f68be374b2e9c6da63626065a41` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:44.672176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f19f68be374b2e9c6da63626065a41)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:44.674138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:44.726196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23201bf82ef340329668c950d3be2f5f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.726895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23201bf82ef340329668c950d3be2f5f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.733799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23201bf82ef340329668c950d3be2f5f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.746030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23201bf82ef340329668c950d3be2f5f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.748160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-316d05e6-f44f-48af-84d8-f983ca516aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23201bf82ef340329668c950d3be2f5f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.828695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 983/1971] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:44 2022] DELETE /identity/v3/users/23201bf82ef340329668c950d3be2f5f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:44.832380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9140e-6d27-447a-9fed-bc1a718e6485 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:44.832723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9140e-6d27-447a-9fed-bc1a718e6485 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:44.833001 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9140e-6d27-447a-9fed-bc1a718e6485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:44.846281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f19f68be374b2e9c6da63626065a41', 'request_id': 'req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.857223 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b5c9140e-6d27-447a-9fed-bc1a718e6485 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:44.858497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b5c9140e-6d27-447a-9fed-bc1a718e6485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:44.918631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 984/1972] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:44.928464 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9140e-6d27-447a-9fed-bc1a718e6485 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:44.929863 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b5c9140e-6d27-447a-9fed-bc1a718e6485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:44.945505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f19f68be374b2e9c6da63626065a41', 'request_id': 'req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.953023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f19f68be374b2e9c6da63626065a41', 'request_id': 'req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.966115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] The token cache is being invalidate because project f4f19f68be374b2e9c6da63626065a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:44.966539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.967237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:44.968876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 989/1973] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:44 2022] DELETE /identity/v3/projects/f4f19f68be374b2e9c6da63626065a41 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:44.973662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:44.975291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:44.990560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb8228-b1a8-4b58-8ac8-992b9ecb83a6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:44.995147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:44.995827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:44.996106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:44.996381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] PATH_INFO: `/v3/users/7afc33170bb242f8a723ff084988be45` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:44.997507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afc33170bb242f8a723ff084988be45)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:44.999453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9140e-6d27-447a-9fed-bc1a718e6485 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:44.999726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:45.003808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:45.004419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:45.004698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:45.004976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:45.006848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:45.019415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:45.020849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:45.030955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 985/1974] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:45.064161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:45.066273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:45.133320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de2dcf-ec7e-4000-9346-4301ead9fc87 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:45.137070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:45.137677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:45.137949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:45.138261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:45.140165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:45.204462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:45.206030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:45.215145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 986/1975] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:45.354260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afc33170bb242f8a723ff084988be45'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.355367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afc33170bb242f8a723ff084988be45'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.466269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afc33170bb242f8a723ff084988be45'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.467865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afc33170bb242f8a723ff084988be45'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.476996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afc33170bb242f8a723ff084988be45'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.483984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 990/1976] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:44 2022] DELETE /identity/v3/users/7afc33170bb242f8a723ff084988be45 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:45.519964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:45.525204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:45.539196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb95fb-09c9-4f43-900c-8a1827c8208f service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:45.607730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:45.608292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:45.608570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:45.608844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] PATH_INFO: `/v3/projects/c9347312964c429298703188833119ea` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:45.609968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9347312964c429298703188833119ea)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:45.611916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:45.723942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:45.744618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9347312964c429298703188833119ea', 'request_id': 'req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.827018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:45.831714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9347312964c429298703188833119ea', 'request_id': 'req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.839789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9347312964c429298703188833119ea', 'request_id': 'req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.853661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] The token cache is being invalidate because project c9347312964c429298703188833119ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:45.854028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.855614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:45.857423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 987/1977] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:45 2022] DELETE /identity/v3/projects/c9347312964c429298703188833119ea => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:45.865712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:45.865712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:45.879487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b01921-e685-41e8-b02f-3cf56bc182a0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:45.959607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:45.960301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:45.960519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:45.960794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] PATH_INFO: `/v3/users/84ae7b3ce8fb44f990cf7045eb6b188a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:45.967017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ae7b3ce8fb44f990cf7045eb6b188a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:45.967017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:46.158850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:46.158850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:46.180709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea620ff2-798a-47e8-9b74-cacdcc3d4f73 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:46.187816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:46.188484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:46.188824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:46.189031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] PATH_INFO: `/v3/projects/90e8246b5c354d6abde2583662e69fdf` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:46.191617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e8246b5c354d6abde2583662e69fdf)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:46.193484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:46.323450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ae7b3ce8fb44f990cf7045eb6b188a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.336948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e8246b5c354d6abde2583662e69fdf', 'request_id': 'req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.339977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ae7b3ce8fb44f990cf7045eb6b188a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.437313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e8246b5c354d6abde2583662e69fdf', 'request_id': 'req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.445751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e8246b5c354d6abde2583662e69fdf', 'request_id': 'req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.457523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] The token cache is being invalidate because project 90e8246b5c354d6abde2583662e69fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:46.457814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.458514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5e1dcd8a-3dea-4126-a3fa-8e7e66e218b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.460019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 988/1978] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:46 2022] DELETE /identity/v3/projects/90e8246b5c354d6abde2583662e69fdf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:46.469103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a89f-265d-4acf-819c-3e6bf1851c32 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:46.469392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a89f-265d-4acf-819c-3e6bf1851c32 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:46.469672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27a89f-265d-4acf-819c-3e6bf1851c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:46.490978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-0b27a89f-265d-4acf-819c-3e6bf1851c32 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:46.492237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0b27a89f-265d-4acf-819c-3e6bf1851c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:46.561525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 989/1979] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:46.569678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4063-664a-4093-acf4-f5d87b8b9060 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:46.569962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4063-664a-4093-acf4-f5d87b8b9060 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:46.570524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4063-664a-4093-acf4-f5d87b8b9060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:46.586543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ae7b3ce8fb44f990cf7045eb6b188a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.588279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ae7b3ce8fb44f990cf7045eb6b188a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.591828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ba8b4063-664a-4093-acf4-f5d87b8b9060 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:46.595959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ba8b4063-664a-4093-acf4-f5d87b8b9060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:46.598588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ae7b3ce8fb44f990cf7045eb6b188a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:46.603051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 990/1980] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:46.606978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 991/1981] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:45 2022] DELETE /identity/v3/users/84ae7b3ce8fb44f990cf7045eb6b188a => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:46.611477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4063-664a-4093-acf4-f5d87b8b9060 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:46.623744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4063-664a-4093-acf4-f5d87b8b9060 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:46.682985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:46.683628 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:46.683904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:46.684175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:46.684829 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:46.685134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:46.686771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:46.703699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 991/1982] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:46.719118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:46.735521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d22c3-a312-43cf-a306-d4c0633e6a9f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:46.747067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794832-adfc-4d31-8ebb-f09ed1d7f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:46.747953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794832-adfc-4d31-8ebb-f09ed1d7f997 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:46.748379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794832-adfc-4d31-8ebb-f09ed1d7f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:46.748868 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794832-adfc-4d31-8ebb-f09ed1d7f997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:46.751106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f794832-adfc-4d31-8ebb-f09ed1d7f997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:46.754379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f794832-adfc-4d31-8ebb-f09ed1d7f997 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:46.796318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:46.798117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:46.854780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e853d-c9cc-413b-a8e4-e080cf7b55ad admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:46.858620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:46.859125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:46.859401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:46.859671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:46.861412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:46.911148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 992/1983] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:46 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:46.912213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794832-adfc-4d31-8ebb-f09ed1d7f997 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:46.936898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:46.938493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:46.950173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 992/1984] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:47.040252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794832-adfc-4d31-8ebb-f09ed1d7f997 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.045223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa37c6-f2fc-4869-b0fc-6a6a6f317582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.045835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa37c6-f2fc-4869-b0fc-6a6a6f317582 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.046154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa37c6-f2fc-4869-b0fc-6a6a6f317582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.046426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa37c6-f2fc-4869-b0fc-6a6a6f317582 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.047116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa37c6-f2fc-4869-b0fc-6a6a6f317582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.049026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa37c6-f2fc-4869-b0fc-6a6a6f317582 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:47.164594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 993/1985] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:46 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:47.168550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:47.182832 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419afa7d-cc87-4324-b033-e0ecbfbed8a4 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.188597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd724-b2ad-4187-966d-6e105d5d4ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.189594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd724-b2ad-4187-966d-6e105d5d4ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.190823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd724-b2ad-4187-966d-6e105d5d4ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.192005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd724-b2ad-4187-966d-6e105d5d4ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.193144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fd724-b2ad-4187-966d-6e105d5d4ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.199192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fd724-b2ad-4187-966d-6e105d5d4ac9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:47.218918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 993/1986] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:40:47.220040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa37c6-f2fc-4869-b0fc-6a6a6f317582 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:47.244855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa37c6-f2fc-4869-b0fc-6a6a6f317582 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.255262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.255888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.256338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.256620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.257280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.259038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:47.272306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 994/1987] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:47.281203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd724-b2ad-4187-966d-6e105d5d4ac9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:47.292117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd724-b2ad-4187-966d-6e105d5d4ac9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.296916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed88fd-17ea-4c25-9184-81eea96a376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.297569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed88fd-17ea-4c25-9184-81eea96a376b admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.297854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed88fd-17ea-4c25-9184-81eea96a376b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.298174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed88fd-17ea-4c25-9184-81eea96a376b admin admin] PATH_INFO: `/v3/projects/d8c8ae434a3843af86f5f01ee21318a1/users/9dd646e8a2004322a4c5501fca29b98b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.312866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed88fd-17ea-4c25-9184-81eea96a376b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c8ae434a3843af86f5f01ee21318a1, user_id=9dd646e8a2004322a4c5501fca29b98b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.318576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed88fd-17ea-4c25-9184-81eea96a376b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:47.381721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:47.383611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:47.398514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2071fd-b75d-43a1-a2e5-8ec60e2b1757 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.404474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.405107 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.405382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.405820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] PATH_INFO: `/v3/projects/1ec38c21388f4166926646feff698da2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.407187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec38c21388f4166926646feff698da2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.409132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:47.422075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:47.427533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 994/1988] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:47 2022] PUT /identity/v3/projects/d8c8ae434a3843af86f5f01ee21318a1/users/9dd646e8a2004322a4c5501fca29b98b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:47.444116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a3e8b-a655-4e2b-b5cc-2ebdcacf0367 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.444428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a3e8b-a655-4e2b-b5cc-2ebdcacf0367 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.444743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a3e8b-a655-4e2b-b5cc-2ebdcacf0367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.475038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-856a3e8b-a655-4e2b-b5cc-2ebdcacf0367 None None] MFA Rules not processed for user `9dd646e8a2004322a4c5501fca29b98b`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:47.476294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-856a3e8b-a655-4e2b-b5cc-2ebdcacf0367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:47.544707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 995/1989] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:47.546204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:47.548879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a3e8b-a655-4e2b-b5cc-2ebdcacf0367 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:47.610397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec38c21388f4166926646feff698da2', 'request_id': 'req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:47.612452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a3e8b-a655-4e2b-b5cc-2ebdcacf0367 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.674591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.674591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.674591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.674591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.675051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.675051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:47.693658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec38c21388f4166926646feff698da2', 'request_id': 'req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:47.699870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec38c21388f4166926646feff698da2', 'request_id': 'req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:47.711691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] The token cache is being invalidate because project 1ec38c21388f4166926646feff698da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:47.711979 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:47.712626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ec8a267b-ca61-4bd1-91dc-f472867ee0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:47.714246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 995/1990] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:47 2022] DELETE /identity/v3/projects/1ec38c21388f4166926646feff698da2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:47.719049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3958-5701-40d6-93f8-b6d736c27ec5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.719331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3958-5701-40d6-93f8-b6d736c27ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.719607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3958-5701-40d6-93f8-b6d736c27ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.741102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ee8b3958-5701-40d6-93f8-b6d736c27ec5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:47.742341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ee8b3958-5701-40d6-93f8-b6d736c27ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:47.750604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 996/1991] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:47.759310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162cc8f-4db6-4d34-904a-c7bd353e9e87 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.759596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162cc8f-4db6-4d34-904a-c7bd353e9e87 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.759867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162cc8f-4db6-4d34-904a-c7bd353e9e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.780513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7162cc8f-4db6-4d34-904a-c7bd353e9e87 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:47.781713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7162cc8f-4db6-4d34-904a-c7bd353e9e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:47.793403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 997/1992] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:47.794302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162cc8f-4db6-4d34-904a-c7bd353e9e87 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:47.805487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162cc8f-4db6-4d34-904a-c7bd353e9e87 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.821774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 996/1993] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:47 2022] POST /identity/v3/projects => generated 365 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:47.822742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:47.824441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:47.902320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.902320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.902320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.902320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.902724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:47.902724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.902724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:47.914348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 998/1994] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:40:47.916286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a144283-5b9c-4640-88a8-a28d951e0752 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.918823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:47.921887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1eb60-8b90-4ab5-bf3b-acfef06827e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.927420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1eb60-8b90-4ab5-bf3b-acfef06827e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.927420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1eb60-8b90-4ab5-bf3b-acfef06827e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.927420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1eb60-8b90-4ab5-bf3b-acfef06827e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.927420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1eb60-8b90-4ab5-bf3b-acfef06827e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.927420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1eb60-8b90-4ab5-bf3b-acfef06827e1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:47.934048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583ba2-3834-468a-88fe-cf4279638b5b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:47.939781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:47.940984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:47.941312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:47.941548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:47.942216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:47.944168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.037879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 997/1995] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:47 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:48.042734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 999/1996] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:47 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:48.042734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.042947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1eb60-8b90-4ab5-bf3b-acfef06827e1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.044063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:48.053168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1eb60-8b90-4ab5-bf3b-acfef06827e1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.105823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe237bc-8b79-434c-b93a-9f6aa29ba3d7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.109684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.110327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.110602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.110876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.111192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85f7f7-dfe5-4d5b-9720-0ba880de56ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.111826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85f7f7-dfe5-4d5b-9720-0ba880de56ad admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.112092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85f7f7-dfe5-4d5b-9720-0ba880de56ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.112363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85f7f7-dfe5-4d5b-9720-0ba880de56ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.113230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:48.113711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85f7f7-dfe5-4d5b-9720-0ba880de56ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.115345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85f7f7-dfe5-4d5b-9720-0ba880de56ad admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.125458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 998/1997] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:48.126370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85f7f7-dfe5-4d5b-9720-0ba880de56ad admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.139111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85f7f7-dfe5-4d5b-9720-0ba880de56ad admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.143915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb871941-bb87-4af7-af27-c42de13b577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.144715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb871941-bb87-4af7-af27-c42de13b577d admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.144934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb871941-bb87-4af7-af27-c42de13b577d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.145208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb871941-bb87-4af7-af27-c42de13b577d admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.145885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb871941-bb87-4af7-af27-c42de13b577d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.147872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb871941-bb87-4af7-af27-c42de13b577d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.181310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.182779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.193185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1000/1998] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:48.194155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.204674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a3c2-5e40-4290-af10-3a06d840b56b service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.210477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f6a77-70c3-4e86-bf87-93c77fd9b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.221146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f6a77-70c3-4e86-bf87-93c77fd9b5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.221146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f6a77-70c3-4e86-bf87-93c77fd9b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.221146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f6a77-70c3-4e86-bf87-93c77fd9b5a2 admin admin] PATH_INFO: `/v3/projects/b01a86aa6500480597822841ccca0a90/users/12253eb556534575b321a7f8fd254079/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.230688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f6a77-70c3-4e86-bf87-93c77fd9b5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01a86aa6500480597822841ccca0a90, user_id=12253eb556534575b321a7f8fd254079, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.233754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f6a77-70c3-4e86-bf87-93c77fd9b5a2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.288027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 999/1999] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:48 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:48.289271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb871941-bb87-4af7-af27-c42de13b577d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.317014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb871941-bb87-4af7-af27-c42de13b577d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.317866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1001/2000] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:48 2022] PUT /identity/v3/projects/b01a86aa6500480597822841ccca0a90/users/12253eb556534575b321a7f8fd254079/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:48.330466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f6a77-70c3-4e86-bf87-93c77fd9b5a2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.416182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fccb3-972d-4c64-8588-1da2abd44f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.417261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fccb3-972d-4c64-8588-1da2abd44f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.417549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fccb3-972d-4c64-8588-1da2abd44f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.417876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fccb3-972d-4c64-8588-1da2abd44f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.418543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fccb3-972d-4c64-8588-1da2abd44f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.420884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fccb3-972d-4c64-8588-1da2abd44f20 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.444573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1000/2001] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:48.445054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f6a77-70c3-4e86-bf87-93c77fd9b5a2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.447451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fccb3-972d-4c64-8588-1da2abd44f20 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.451881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c459ea1-9d00-4d0a-a690-6c0939fe5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.452721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c459ea1-9d00-4d0a-a690-6c0939fe5d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.453155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c459ea1-9d00-4d0a-a690-6c0939fe5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.454210 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c459ea1-9d00-4d0a-a690-6c0939fe5d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.455015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c459ea1-9d00-4d0a-a690-6c0939fe5d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.458052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c459ea1-9d00-4d0a-a690-6c0939fe5d22 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.474021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1002/2002] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:40:48.475823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c459ea1-9d00-4d0a-a690-6c0939fe5d22 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.480377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fccb3-972d-4c64-8588-1da2abd44f20 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.486558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c459ea1-9d00-4d0a-a690-6c0939fe5d22 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.487389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23ab42-5ea7-46c7-a812-4dd50218e2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.489161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ab42-5ea7-46c7-a812-4dd50218e2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.489461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ab42-5ea7-46c7-a812-4dd50218e2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.489803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ab42-5ea7-46c7-a812-4dd50218e2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.490504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23ab42-5ea7-46c7-a812-4dd50218e2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.492199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23ab42-5ea7-46c7-a812-4dd50218e2c8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.492370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a10c9-24fc-4a9f-a59f-1c52b63d81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.493034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a10c9-24fc-4a9f-a59f-1c52b63d81f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.493308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a10c9-24fc-4a9f-a59f-1c52b63d81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.493638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a10c9-24fc-4a9f-a59f-1c52b63d81f5 admin admin] PATH_INFO: `/v3/projects/b01a86aa6500480597822841ccca0a90/users/12253eb556534575b321a7f8fd254079/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.495672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a10c9-24fc-4a9f-a59f-1c52b63d81f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01a86aa6500480597822841ccca0a90, user_id=12253eb556534575b321a7f8fd254079, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.499008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a10c9-24fc-4a9f-a59f-1c52b63d81f5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.504528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1001/2003] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:48.508652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23ab42-5ea7-46c7-a812-4dd50218e2c8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.511313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1003/2004] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:48 2022] PUT /identity/v3/projects/b01a86aa6500480597822841ccca0a90/users/12253eb556534575b321a7f8fd254079/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:48.518834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23ab42-5ea7-46c7-a812-4dd50218e2c8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.522075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ae07-5738-412a-8e73-83d59b587597 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.522562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ae07-5738-412a-8e73-83d59b587597 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.523038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47ae07-5738-412a-8e73-83d59b587597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.553455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9c47ae07-5738-412a-8e73-83d59b587597 None None] MFA Rules not processed for user `12253eb556534575b321a7f8fd254079`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:48.554800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9c47ae07-5738-412a-8e73-83d59b587597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:48.581386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6438-dacc-4540-a7f0-6c82aa485b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.582810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6438-dacc-4540-a7f0-6c82aa485b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.583095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6438-dacc-4540-a7f0-6c82aa485b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.584621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6438-dacc-4540-a7f0-6c82aa485b08 admin admin] PATH_INFO: `/v3/projects/bd166f7ad78c4c938e61b22382f38c4d/users/0173d5023420446cae5c8c1914b3c067/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.599212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f6438-dacc-4540-a7f0-6c82aa485b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd166f7ad78c4c938e61b22382f38c4d, user_id=0173d5023420446cae5c8c1914b3c067, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.602081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f6438-dacc-4540-a7f0-6c82aa485b08 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.630484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1004/2005] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:48.712026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1002/2006] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:48 2022] PUT /identity/v3/projects/bd166f7ad78c4c938e61b22382f38c4d/users/0173d5023420446cae5c8c1914b3c067/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:48.722442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd142b8-c57f-4746-a212-dba0a9ef7540 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.722442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd142b8-c57f-4746-a212-dba0a9ef7540 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.723092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd142b8-c57f-4746-a212-dba0a9ef7540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.753191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5cd142b8-c57f-4746-a212-dba0a9ef7540 None None] MFA Rules not processed for user `0173d5023420446cae5c8c1914b3c067`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:48.755114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5cd142b8-c57f-4746-a212-dba0a9ef7540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:48.821781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1005/2007] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:48.826526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6438-dacc-4540-a7f0-6c82aa485b08 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.868905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd142b8-c57f-4746-a212-dba0a9ef7540 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:48.950447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6438-dacc-4540-a7f0-6c82aa485b08 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.955712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530b99-861b-4459-a915-357df99bb842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.956358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530b99-861b-4459-a915-357df99bb842 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.957344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530b99-861b-4459-a915-357df99bb842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.957707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530b99-861b-4459-a915-357df99bb842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:48.959045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b530b99-861b-4459-a915-357df99bb842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:48.960960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b530b99-861b-4459-a915-357df99bb842 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:48.967148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd142b8-c57f-4746-a212-dba0a9ef7540 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:48.971365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e511-52a9-409e-a3a3-f456f26eddbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:48.972111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e511-52a9-409e-a3a3-f456f26eddbb service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:48.972490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e511-52a9-409e-a3a3-f456f26eddbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:48.972916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e511-52a9-409e-a3a3-f456f26eddbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:49.077478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8e511-52a9-409e-a3a3-f456f26eddbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:49.079116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8e511-52a9-409e-a3a3-f456f26eddbb service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:49.090332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1006/2008] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:49.136145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1003/2009] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:48 2022] POST /identity/v3/projects => generated 363 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:49.140241 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e511-52a9-409e-a3a3-f456f26eddbb service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:49.151603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e511-52a9-409e-a3a3-f456f26eddbb service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:49.209572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:49.213869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbcbf9-3e86-4656-b1d6-76d0622351c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:49.218559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbcbf9-3e86-4656-b1d6-76d0622351c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:49.218559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbcbf9-3e86-4656-b1d6-76d0622351c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:49.218559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbcbf9-3e86-4656-b1d6-76d0622351c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:49.218559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbcbf9-3e86-4656-b1d6-76d0622351c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:49.218559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbcbf9-3e86-4656-b1d6-76d0622351c4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:49.345887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1007/2010] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:49 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:49.350676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530b99-861b-4459-a915-357df99bb842 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:49.361858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530b99-861b-4459-a915-357df99bb842 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:49.367701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3dec-0d7e-4eda-8d83-6baa11728dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:49.368519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3dec-0d7e-4eda-8d83-6baa11728dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:49.368767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3dec-0d7e-4eda-8d83-6baa11728dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:49.369046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3dec-0d7e-4eda-8d83-6baa11728dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:49.370575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3dec-0d7e-4eda-8d83-6baa11728dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:49.371817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3dec-0d7e-4eda-8d83-6baa11728dc9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:49.385834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1004/2011] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:49.390227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbcbf9-3e86-4656-b1d6-76d0622351c4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:49.404315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3dec-0d7e-4eda-8d83-6baa11728dc9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:49.408470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbcbf9-3e86-4656-b1d6-76d0622351c4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:49.416987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e709b2f-3a16-4502-952d-1ba18e30be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:49.418063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e709b2f-3a16-4502-952d-1ba18e30be15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:49.418467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e709b2f-3a16-4502-952d-1ba18e30be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:49.418875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e709b2f-3a16-4502-952d-1ba18e30be15 admin admin] PATH_INFO: `/v3/projects/c2675e6d5d394d8aaaf7fa10d3159315/users/7fc3268831014f408dff52344bff94d0/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:49.439345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e709b2f-3a16-4502-952d-1ba18e30be15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2675e6d5d394d8aaaf7fa10d3159315, user_id=7fc3268831014f408dff52344bff94d0, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:49.443593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e709b2f-3a16-4502-952d-1ba18e30be15 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:49.467295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3dec-0d7e-4eda-8d83-6baa11728dc9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:49.475139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:49.475818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:49.476039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:49.476329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:49.478786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:49.547760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:49.549228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:49.565826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1008/2012] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:49 2022] PUT /identity/v3/projects/c2675e6d5d394d8aaaf7fa10d3159315/users/7fc3268831014f408dff52344bff94d0/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:49.566014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1005/2013] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:49.570684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e709b2f-3a16-4502-952d-1ba18e30be15 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:49.657578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e709b2f-3a16-4502-952d-1ba18e30be15 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:49.666121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2ade7-cbeb-424d-9560-0930dc021874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:49.666752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2ade7-cbeb-424d-9560-0930dc021874 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:49.667221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2ade7-cbeb-424d-9560-0930dc021874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:49.667506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2ade7-cbeb-424d-9560-0930dc021874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:49.668166 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2ade7-cbeb-424d-9560-0930dc021874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:49.670686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2ade7-cbeb-424d-9560-0930dc021874 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:49.687157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1009/2014] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:49.691318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:49.704276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f933c40-5697-4eca-830e-0009eb814ec3 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:49.709358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2bba0-f55a-430f-a09e-7e66d3ae4b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:49.710138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2bba0-f55a-430f-a09e-7e66d3ae4b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:49.710484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2bba0-f55a-430f-a09e-7e66d3ae4b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:49.710943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2bba0-f55a-430f-a09e-7e66d3ae4b4e admin admin] PATH_INFO: `/v3/projects/c2675e6d5d394d8aaaf7fa10d3159315/users/7fc3268831014f408dff52344bff94d0/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:49.712876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2bba0-f55a-430f-a09e-7e66d3ae4b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2675e6d5d394d8aaaf7fa10d3159315, user_id=7fc3268831014f408dff52344bff94d0, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:49.715855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2bba0-f55a-430f-a09e-7e66d3ae4b4e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:49.728232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1006/2015] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:49 2022] PUT /identity/v3/projects/c2675e6d5d394d8aaaf7fa10d3159315/users/7fc3268831014f408dff52344bff94d0/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:49.739826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a30a-682a-48c8-8e51-9bc70b95ab0f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:49.740171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a30a-682a-48c8-8e51-9bc70b95ab0f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:49.740455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9a30a-682a-48c8-8e51-9bc70b95ab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:49.773461 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-deb9a30a-682a-48c8-8e51-9bc70b95ab0f None None] MFA Rules not processed for user `7fc3268831014f408dff52344bff94d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:49.775279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-deb9a30a-682a-48c8-8e51-9bc70b95ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:49.851009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:49.861087 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1010/2016] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:50.575990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2bba0-f55a-430f-a09e-7e66d3ae4b4e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:50.631735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2bba0-f55a-430f-a09e-7e66d3ae4b4e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:50.635377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b76d-092d-4244-9475-2440b7a476b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:50.635980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b76d-092d-4244-9475-2440b7a476b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:50.636256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b76d-092d-4244-9475-2440b7a476b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:50.636526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b76d-092d-4244-9475-2440b7a476b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:50.645741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808b76d-092d-4244-9475-2440b7a476b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:50.651390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808b76d-092d-4244-9475-2440b7a476b0 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:50.656730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1007/2017] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:50.814071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:51.165048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a30a-682a-48c8-8e51-9bc70b95ab0f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:51.166544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-deb9a30a-682a-48c8-8e51-9bc70b95ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:51.168607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b76d-092d-4244-9475-2440b7a476b0 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:51.178149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b76d-092d-4244-9475-2440b7a476b0 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:51.181941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bb400-a827-4fed-9d42-093e5e1ea14d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:51.182575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb400-a827-4fed-9d42-093e5e1ea14d service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:51.182849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb400-a827-4fed-9d42-093e5e1ea14d service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:51.183115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bb400-a827-4fed-9d42-093e5e1ea14d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:51.237107 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9a30a-682a-48c8-8e51-9bc70b95ab0f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:51.241925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bb400-a827-4fed-9d42-093e5e1ea14d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:51.243465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bb400-a827-4fed-9d42-093e5e1ea14d service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:51.248205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:51.249050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:51.249334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:51.249878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] PATH_INFO: `/v3/users/6713c37cc25c495c84602b1713125c3b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:51.250987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6713c37cc25c495c84602b1713125c3b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:51.253008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:51.254633 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1008/2018] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:51.475921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6713c37cc25c495c84602b1713125c3b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:51.490314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6713c37cc25c495c84602b1713125c3b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:51.631497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6713c37cc25c495c84602b1713125c3b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:51.632119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6713c37cc25c495c84602b1713125c3b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:51.639781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6713c37cc25c495c84602b1713125c3b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:51.645575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1011/2019] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:51 2022] DELETE /identity/v3/users/6713c37cc25c495c84602b1713125c3b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:51.650317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50156-09b1-45a8-a489-6e4d163087a5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:51.650610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50156-09b1-45a8-a489-6e4d163087a5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:51.650889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50156-09b1-45a8-a489-6e4d163087a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:51.672037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9ae50156-09b1-45a8-a489-6e4d163087a5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:51.675377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9ae50156-09b1-45a8-a489-6e4d163087a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:51.756645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1009/2020] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:51.766624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:51.768046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:51.836411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704786ed-1a2e-45b6-8d6a-eb3ac8efe832 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:51.840008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad76098-6776-4e50-8e48-bc0d4893a52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:51.840644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76098-6776-4e50-8e48-bc0d4893a52a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:51.840923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76098-6776-4e50-8e48-bc0d4893a52a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:51.841197 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad76098-6776-4e50-8e48-bc0d4893a52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:51.851272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad76098-6776-4e50-8e48-bc0d4893a52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:51.852851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad76098-6776-4e50-8e48-bc0d4893a52a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:51.862712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1012/2021] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:52.266334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:52.496196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50156-09b1-45a8-a489-6e4d163087a5 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:52.497760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9ae50156-09b1-45a8-a489-6e4d163087a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:52.517224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50156-09b1-45a8-a489-6e4d163087a5 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:52.524278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:52.525002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:52.525285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:52.525718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] PATH_INFO: `/v3/projects/efaf2eb1ef3944c5a047e335342b7ff3` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:52.527260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efaf2eb1ef3944c5a047e335342b7ff3)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:52.529218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:52.659710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efaf2eb1ef3944c5a047e335342b7ff3', 'request_id': 'req-44ecfa8b-1825-419d-965f-e9cc6068a7d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:52.781117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efaf2eb1ef3944c5a047e335342b7ff3', 'request_id': 'req-44ecfa8b-1825-419d-965f-e9cc6068a7d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:52.800558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efaf2eb1ef3944c5a047e335342b7ff3', 'request_id': 'req-44ecfa8b-1825-419d-965f-e9cc6068a7d7'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:52.813903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] The token cache is being invalidate because project efaf2eb1ef3944c5a047e335342b7ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:52.814321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:52.815301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:52.816934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1010/2022] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:52 2022] DELETE /identity/v3/projects/efaf2eb1ef3944c5a047e335342b7ff3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:52.821380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad76098-6776-4e50-8e48-bc0d4893a52a service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:52.831258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad76098-6776-4e50-8e48-bc0d4893a52a service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:52.890139 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:52.890771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:52.890979 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:52.891283 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] PATH_INFO: `/v3/users/fde954e8636d407da5062f69b31c79e5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:52.892421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde954e8636d407da5062f69b31c79e5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:52.895144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:53.169169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde954e8636d407da5062f69b31c79e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.184514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde954e8636d407da5062f69b31c79e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.293902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde954e8636d407da5062f69b31c79e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.294561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde954e8636d407da5062f69b31c79e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.302597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde954e8636d407da5062f69b31c79e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.308827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1013/2023] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:52 2022] DELETE /identity/v3/users/fde954e8636d407da5062f69b31c79e5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:53.363025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:53.514912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:53.516819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:53.530471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecfa8b-1825-419d-965f-e9cc6068a7d7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:53.607023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:53.607743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:53.608098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:53.608438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] PATH_INFO: `/v3/users/ee5cb9f3752c450c823f26ede744976b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:53.609689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5cb9f3752c450c823f26ede744976b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:53.611820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:53.781521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:53.783240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:53.797819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd6ad-6b29-4e4e-94bb-1ebab04d6472 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:53.803499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:53.804149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:53.804432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:53.804708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] PATH_INFO: `/v3/projects/6fa43587e2d34679a447f07d3344abf3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:53.806096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa43587e2d34679a447f07d3344abf3)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:53.808009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:53.927088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5cb9f3752c450c823f26ede744976b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.927781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5cb9f3752c450c823f26ede744976b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.935280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5cb9f3752c450c823f26ede744976b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.948153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5cb9f3752c450c823f26ede744976b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.948884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e7bb2ffa-7fb2-44d5-ae96-ca4b816d47e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5cb9f3752c450c823f26ede744976b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:53.998437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa43587e2d34679a447f07d3344abf3', 'request_id': 'req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.127075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1011/2024] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:53 2022] DELETE /identity/v3/users/ee5cb9f3752c450c823f26ede744976b => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:54.131751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae6ea-11c6-4345-b3af-6609dbc934b5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:54.132042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae6ea-11c6-4345-b3af-6609dbc934b5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:54.132371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae6ea-11c6-4345-b3af-6609dbc934b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:54.152115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-beaae6ea-11c6-4345-b3af-6609dbc934b5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:54.153688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-beaae6ea-11c6-4345-b3af-6609dbc934b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:54.213538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1012/2025] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:40:54.223092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaae6ea-11c6-4345-b3af-6609dbc934b5 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:54.224520 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-beaae6ea-11c6-4345-b3af-6609dbc934b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:54.283204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaae6ea-11c6-4345-b3af-6609dbc934b5 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:54.287279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:54.287899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:54.288185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:54.288459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:54.293418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa43587e2d34679a447f07d3344abf3', 'request_id': 'req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.299016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:54.300608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:54.301487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa43587e2d34679a447f07d3344abf3', 'request_id': 'req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.315353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] The token cache is being invalidate because project 6fa43587e2d34679a447f07d3344abf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:54.315353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.315544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1013/2026] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:40:54.315642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.317592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1014/2027] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:53 2022] DELETE /identity/v3/projects/6fa43587e2d34679a447f07d3344abf3 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:54.322029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:54.323444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:54.337704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c2399-04fc-49a2-883e-e93e737528fb service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:54.343065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:54.344099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:54.344383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:54.344654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] PATH_INFO: `/v3/users/238474fd20eb40df8051b8af33f53157` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:54.345843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238474fd20eb40df8051b8af33f53157)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:54.347868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:54.605650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238474fd20eb40df8051b8af33f53157'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.606474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238474fd20eb40df8051b8af33f53157'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.614833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238474fd20eb40df8051b8af33f53157'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.630482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238474fd20eb40df8051b8af33f53157'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.631218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238474fd20eb40df8051b8af33f53157'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:54.756481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1014/2028] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:54 2022] DELETE /identity/v3/users/238474fd20eb40df8051b8af33f53157 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:54.788650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:54.790311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:54.871792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019cf38-f0c9-498b-9e2a-fd16aeb9701a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:54.937596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:54.938338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:54.938622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:54.938894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] PATH_INFO: `/v3/projects/ef8e3b942bc3451a85641547f0ceb1f5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:54.940084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8e3b942bc3451a85641547f0ceb1f5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:54.942138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:55.133010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:55.134578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:55.148398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508a969-6aed-4414-9518-fca173cab181 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:55.155979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:55.157198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:55.157630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:55.158106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] PATH_INFO: `/v3/users/0173d5023420446cae5c8c1914b3c067` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:55.160068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0173d5023420446cae5c8c1914b3c067)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:55.162282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:55.195236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8e3b942bc3451a85641547f0ceb1f5', 'request_id': 'req-09cf34ec-2497-49d5-bef1-7a78d96c62ec'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.290997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8e3b942bc3451a85641547f0ceb1f5', 'request_id': 'req-09cf34ec-2497-49d5-bef1-7a78d96c62ec'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.299139 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8e3b942bc3451a85641547f0ceb1f5', 'request_id': 'req-09cf34ec-2497-49d5-bef1-7a78d96c62ec'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.330788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] The token cache is being invalidate because project ef8e3b942bc3451a85641547f0ceb1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:55.330788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.338514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.338514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1015/2029] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:54 2022] DELETE /identity/v3/projects/ef8e3b942bc3451a85641547f0ceb1f5 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:55.338514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:55.338514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:55.361261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:55.388379 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0173d5023420446cae5c8c1914b3c067'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.400649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0173d5023420446cae5c8c1914b3c067'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.411191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0173d5023420446cae5c8c1914b3c067'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.417469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf34ec-2497-49d5-bef1-7a78d96c62ec admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:55.423640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:55.424384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:55.424733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:55.425072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] PATH_INFO: `/v3/projects/835fa89bb3c647738111f6bdf53b06da` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:55.426729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0173d5023420446cae5c8c1914b3c067'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.427084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=835fa89bb3c647738111f6bdf53b06da)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:55.427798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0173d5023420446cae5c8c1914b3c067'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.429339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:55.517030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1015/2030] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:55 2022] DELETE /identity/v3/users/0173d5023420446cae5c8c1914b3c067 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:55.518057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:55.519899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:55.599094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9349044-6163-408e-9c50-080a725cfc6b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:55.644413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835fa89bb3c647738111f6bdf53b06da', 'request_id': 'req-85bd25aa-b33a-41e6-abd2-48f98473d40a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.685123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:55.686423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:55.686847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:55.687258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] PATH_INFO: `/v3/users/e1663a4be64a4402b395f30dc627acdc` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:55.688714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1663a4be64a4402b395f30dc627acdc)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:55.691539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:55.819149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835fa89bb3c647738111f6bdf53b06da', 'request_id': 'req-85bd25aa-b33a-41e6-abd2-48f98473d40a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.825865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835fa89bb3c647738111f6bdf53b06da', 'request_id': 'req-85bd25aa-b33a-41e6-abd2-48f98473d40a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.838012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] The token cache is being invalidate because project 835fa89bb3c647738111f6bdf53b06da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:55.838315 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.838982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85bd25aa-b33a-41e6-abd2-48f98473d40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:55.840481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1016/2031] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:55 2022] DELETE /identity/v3/projects/835fa89bb3c647738111f6bdf53b06da => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:55.841901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852ef3-cf95-4d84-98fc-9fdbb53a5e9a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:55.842323 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852ef3-cf95-4d84-98fc-9fdbb53a5e9a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:55.842605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852ef3-cf95-4d84-98fc-9fdbb53a5e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:55.862192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d9852ef3-cf95-4d84-98fc-9fdbb53a5e9a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:55.864152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d9852ef3-cf95-4d84-98fc-9fdbb53a5e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:55.871961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1017/2032] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:55.872734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9852ef3-cf95-4d84-98fc-9fdbb53a5e9a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:55.874025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d9852ef3-cf95-4d84-98fc-9fdbb53a5e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:55.885862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9852ef3-cf95-4d84-98fc-9fdbb53a5e9a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:55.894033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:55.894709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:55.898706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:55.898706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] PATH_INFO: `/v3/users/8ddba5d7b5ff4735b9e6a961555498f2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:55.898706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddba5d7b5ff4735b9e6a961555498f2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:55.898706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:56.074645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1663a4be64a4402b395f30dc627acdc'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.075289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1663a4be64a4402b395f30dc627acdc'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.092963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1663a4be64a4402b395f30dc627acdc'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.098812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1663a4be64a4402b395f30dc627acdc'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.099548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-816d061f-e568-4f6b-8094-7afe0266488b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1663a4be64a4402b395f30dc627acdc'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.200090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddba5d7b5ff4735b9e6a961555498f2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.214121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddba5d7b5ff4735b9e6a961555498f2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.220433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1016/2033] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:55 2022] DELETE /identity/v3/users/e1663a4be64a4402b395f30dc627acdc => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:56.221796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0fd2-f746-4e44-83c8-6bbd84d6d7f6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.222346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0fd2-f746-4e44-83c8-6bbd84d6d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.223235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c0fd2-f746-4e44-83c8-6bbd84d6d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.256002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-409c0fd2-f746-4e44-83c8-6bbd84d6d7f6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:56.257477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-409c0fd2-f746-4e44-83c8-6bbd84d6d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:56.316468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddba5d7b5ff4735b9e6a961555498f2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.317307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddba5d7b5ff4735b9e6a961555498f2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.334204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a03651bf-168b-45c7-97fc-45c0338e21dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddba5d7b5ff4735b9e6a961555498f2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:56.334415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1017/2034] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:56.334415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c0fd2-f746-4e44-83c8-6bbd84d6d7f6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:56.334415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-409c0fd2-f746-4e44-83c8-6bbd84d6d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:56.342981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1018/2035] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:55 2022] DELETE /identity/v3/users/8ddba5d7b5ff4735b9e6a961555498f2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:56.344144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40daa-c4fc-458c-ad6d-1431026c8f94 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.344868 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40daa-c4fc-458c-ad6d-1431026c8f94 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.344868 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40daa-c4fc-458c-ad6d-1431026c8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.364339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0ae40daa-c4fc-458c-ad6d-1431026c8f94 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:56.365559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0ae40daa-c4fc-458c-ad6d-1431026c8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:56.396369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c0fd2-f746-4e44-83c8-6bbd84d6d7f6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:56.415833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:56.471615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1019/2036] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:56.473751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef585-179a-4cdb-9431-a61acffe3a97 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.474303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef585-179a-4cdb-9431-a61acffe3a97 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.474587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef585-179a-4cdb-9431-a61acffe3a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.524042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6fbef585-179a-4cdb-9431-a61acffe3a97 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:56.525289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6fbef585-179a-4cdb-9431-a61acffe3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:56.525827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:56.526867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.527674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.528088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.530355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:56.533678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1020/2037] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:56.543898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef585-179a-4cdb-9431-a61acffe3a97 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:56.549456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef585-179a-4cdb-9431-a61acffe3a97 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:56.556281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:56.556869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:56.556994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.557170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.557447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.558159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:56.558485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:56.559834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:56.560241 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:56.579355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1018/2038] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:56.581047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:56.585446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1021/2039] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:56.589318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:56.607220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850fad6-2710-41fe-acbc-e518162d411f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:56.609160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b1c51-7d41-4949-896c-8c19552edfec service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:56.614527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:56.616593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.617296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.617727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.618733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:56.620910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:56.635125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df66e3-6eac-4ffd-97f8-01f900698d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:56.636532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df66e3-6eac-4ffd-97f8-01f900698d8c service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.636737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df66e3-6eac-4ffd-97f8-01f900698d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.637117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df66e3-6eac-4ffd-97f8-01f900698d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.655048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df66e3-6eac-4ffd-97f8-01f900698d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:56.657241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df66e3-6eac-4ffd-97f8-01f900698d8c service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:56.674596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1019/2040] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:56.712331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1022/2041] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:56 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:40:56.713193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df66e3-6eac-4ffd-97f8-01f900698d8c service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:56.727723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df66e3-6eac-4ffd-97f8-01f900698d8c service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:56.829423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cb449-f177-4369-b632-53fac5dbe708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:56.830093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb449-f177-4369-b632-53fac5dbe708 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.830376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb449-f177-4369-b632-53fac5dbe708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.830694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb449-f177-4369-b632-53fac5dbe708 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.831328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cb449-f177-4369-b632-53fac5dbe708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:56.833289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cb449-f177-4369-b632-53fac5dbe708 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:56.906986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:56.912364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:56.932590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520871-688f-45f0-8d3b-cd7eb0779e21 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:56.945804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:56.946736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:56.947017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:56.947470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] PATH_INFO: `/v3/projects/9254cc9a35db457e9434c87bd55d13d0` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:56.948797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9254cc9a35db457e9434c87bd55d13d0)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:56.951495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:56.982269 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1020/2042] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:56 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:56.987093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cb449-f177-4369-b632-53fac5dbe708 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:57.015718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cb449-f177-4369-b632-53fac5dbe708 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:57.019168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8a283-20ac-4f8d-9514-0aebd654bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:57.020027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8a283-20ac-4f8d-9514-0aebd654bb99 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:57.020444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8a283-20ac-4f8d-9514-0aebd654bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:57.021240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8a283-20ac-4f8d-9514-0aebd654bb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:57.022077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8a283-20ac-4f8d-9514-0aebd654bb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:57.024585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8a283-20ac-4f8d-9514-0aebd654bb99 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:57.028168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:57.052968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1021/2043] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:40:57.064193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8a283-20ac-4f8d-9514-0aebd654bb99 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:57.104206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8a283-20ac-4f8d-9514-0aebd654bb99 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:57.107094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9254cc9a35db457e9434c87bd55d13d0', 'request_id': 'req-236cd3b1-5dca-4a66-8e34-abe3c5b46040'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.176738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9254cc9a35db457e9434c87bd55d13d0', 'request_id': 'req-236cd3b1-5dca-4a66-8e34-abe3c5b46040'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.187095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:57.188525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9254cc9a35db457e9434c87bd55d13d0', 'request_id': 'req-236cd3b1-5dca-4a66-8e34-abe3c5b46040'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.188940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:57.192111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:57.192111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:57.192111 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:57.193957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:57.209752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] The token cache is being invalidate because project 9254cc9a35db457e9434c87bd55d13d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:57.210900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.217176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.217176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1023/2044] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:56 2022] DELETE /identity/v3/projects/9254cc9a35db457e9434c87bd55d13d0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:40:57.217527 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1022/2045] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:57.217964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:57.218483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:57.220523 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:57.220642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:57.239069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cd3b1-5dca-4a66-8e34-abe3c5b46040 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:57.248204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeacc5c-dc5c-4964-bbbd-2e051d08b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:57.248993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacc5c-dc5c-4964-bbbd-2e051d08b39d admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:57.249347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacc5c-dc5c-4964-bbbd-2e051d08b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:57.250325 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacc5c-dc5c-4964-bbbd-2e051d08b39d admin admin] PATH_INFO: `/v3/projects/33fd87484ee4468eb288821d3885b8ba/users/215a13dbdf134d16a940a903c989f1a4/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:57.258445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bc045-a532-4446-b95a-62577aa78937 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:57.267310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:57.268140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:57.268430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:57.268704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] PATH_INFO: `/v3/users/ecd75118d6d3477380b72603c1cee629` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:57.270666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd75118d6d3477380b72603c1cee629)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:57.272537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:57.272945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeacc5c-dc5c-4964-bbbd-2e051d08b39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fd87484ee4468eb288821d3885b8ba, user_id=215a13dbdf134d16a940a903c989f1a4, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:57.277144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeacc5c-dc5c-4964-bbbd-2e051d08b39d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:57.369447 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1024/2046] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:57 2022] PUT /identity/v3/projects/33fd87484ee4468eb288821d3885b8ba/users/215a13dbdf134d16a940a903c989f1a4/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:57.383253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583dac0-6361-4580-a85d-c51ffb2ddcd5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:57.383511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583dac0-6361-4580-a85d-c51ffb2ddcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:57.383844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583dac0-6361-4580-a85d-c51ffb2ddcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:57.423700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d583dac0-6361-4580-a85d-c51ffb2ddcd5 None None] MFA Rules not processed for user `215a13dbdf134d16a940a903c989f1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:57.425214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d583dac0-6361-4580-a85d-c51ffb2ddcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:57.482913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd75118d6d3477380b72603c1cee629'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.484183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd75118d6d3477380b72603c1cee629'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.496033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd75118d6d3477380b72603c1cee629'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.514970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd75118d6d3477380b72603c1cee629'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.520013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1025/2047] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:57.520013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583dac0-6361-4580-a85d-c51ffb2ddcd5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:57.520876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd75118d6d3477380b72603c1cee629'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:57.524330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d583dac0-6361-4580-a85d-c51ffb2ddcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:57.600449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1023/2048] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:57 2022] DELETE /identity/v3/users/ecd75118d6d3477380b72603c1cee629 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:57.602481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:57.611513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:57.643558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583dac0-6361-4580-a85d-c51ffb2ddcd5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:57.773918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:57.774727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:57.775068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:57.775509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] PATH_INFO: `/v3/projects/43082004b3384595808e678043860e17` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:57.776806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43082004b3384595808e678043860e17)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:57.777870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7462-0782-446b-aed8-e3826856c760 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:57.779427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:57.791483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:57.798428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:57.798428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:57.798428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:57.798428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] PATH_INFO: `/v3/projects/bd166f7ad78c4c938e61b22382f38c4d` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:57.807114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd166f7ad78c4c938e61b22382f38c4d)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:57.809402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:57.985331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43082004b3384595808e678043860e17', 'request_id': 'req-97b468a9-13ab-448b-9955-2ea8626a9f94'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.042168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd166f7ad78c4c938e61b22382f38c4d', 'request_id': 'req-6e99b5ef-a98e-4409-98f0-a5414ebd168e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.087927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43082004b3384595808e678043860e17', 'request_id': 'req-97b468a9-13ab-448b-9955-2ea8626a9f94'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.095701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43082004b3384595808e678043860e17', 'request_id': 'req-97b468a9-13ab-448b-9955-2ea8626a9f94'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.119805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] The token cache is being invalidate because project 43082004b3384595808e678043860e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:58.120110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.168877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.168877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1026/2049] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:57 2022] DELETE /identity/v3/projects/43082004b3384595808e678043860e17 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:58.168877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:58.168877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:58.283038 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b468a9-13ab-448b-9955-2ea8626a9f94 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:58.322455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd166f7ad78c4c938e61b22382f38c4d', 'request_id': 'req-6e99b5ef-a98e-4409-98f0-a5414ebd168e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.330858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd166f7ad78c4c938e61b22382f38c4d', 'request_id': 'req-6e99b5ef-a98e-4409-98f0-a5414ebd168e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.332000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:58.332853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:58.333130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:58.333432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:58.334118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:58.336004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:58.342953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] The token cache is being invalidate because project bd166f7ad78c4c938e61b22382f38c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:58.343348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.344159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.346784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1024/2050] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:57 2022] DELETE /identity/v3/projects/bd166f7ad78c4c938e61b22382f38c4d => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:58.347988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:58.349878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:58.364362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99b5ef-a98e-4409-98f0-a5414ebd168e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:58.369244 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:58.369888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:58.370194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:58.370469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] PATH_INFO: `/v3/users/9dd646e8a2004322a4c5501fca29b98b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:58.371648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd646e8a2004322a4c5501fca29b98b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:58.373680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:58.443133 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1027/2051] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:58 2022] POST /identity/v3/projects => generated 377 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:58.443133 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:58.447499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:58.520163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153dd1a-db51-4dbf-83be-92ce666219ec admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:58.525618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:58.536418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:58.536418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:58.536418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] PATH_INFO: `/v3/users/b11f682a4ead488890a836a4a1bdc9e1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:58.536418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11f682a4ead488890a836a4a1bdc9e1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:58.536418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:58.594499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd646e8a2004322a4c5501fca29b98b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.595252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd646e8a2004322a4c5501fca29b98b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.604252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd646e8a2004322a4c5501fca29b98b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.618765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd646e8a2004322a4c5501fca29b98b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.619527 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd646e8a2004322a4c5501fca29b98b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.699917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1025/2052] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:58 2022] DELETE /identity/v3/users/9dd646e8a2004322a4c5501fca29b98b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:58.701160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:58.702616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:58.780246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11f682a4ead488890a836a4a1bdc9e1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.783034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03433108-40d8-4a1e-a710-1f096680a1e3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:58.788202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:58.788838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:58.789122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:58.789400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] PATH_INFO: `/v3/users/7fc3268831014f408dff52344bff94d0` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:58.790572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc3268831014f408dff52344bff94d0)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:58.792488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:58.792850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:58.797765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11f682a4ead488890a836a4a1bdc9e1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.848184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:40:58.899503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11f682a4ead488890a836a4a1bdc9e1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.900249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11f682a4ead488890a836a4a1bdc9e1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.907911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11f682a4ead488890a836a4a1bdc9e1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:58.913960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1028/2053] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:58 2022] DELETE /identity/v3/users/b11f682a4ead488890a836a4a1bdc9e1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:58.914767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:58.916110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:58.995758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade022-a8bb-48c2-9a8e-f594ce5372d9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:59.002270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:59.003438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.003438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.003692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] PATH_INFO: `/v3/projects/eec2ffc1eae14e4583aa004548fd8c23` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.006013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec2ffc1eae14e4583aa004548fd8c23)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:59.008757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:59.065367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc3268831014f408dff52344bff94d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.066870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc3268831014f408dff52344bff94d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.074525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc3268831014f408dff52344bff94d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.087201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc3268831014f408dff52344bff94d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.087954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc3268831014f408dff52344bff94d0'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.209316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec2ffc1eae14e4583aa004548fd8c23', 'request_id': 'req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.236235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1026/2054] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:40:58 2022] DELETE /identity/v3/users/7fc3268831014f408dff52344bff94d0 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:59.236235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:59.236235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:59.334858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d183-e01c-47fd-8f8c-b73da16962ad admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:59.340289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:59.340627 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec2ffc1eae14e4583aa004548fd8c23', 'request_id': 'req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.341167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.341602 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.342002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.342877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:59.345328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:59.386804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec2ffc1eae14e4583aa004548fd8c23', 'request_id': 'req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.407748 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] The token cache is being invalidate because project eec2ffc1eae14e4583aa004548fd8c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:40:59.408296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.409077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b6424acd-a2d6-40e2-a650-c7f4c8f7402f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:40:59.415319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1029/2055] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:58 2022] DELETE /identity/v3/projects/eec2ffc1eae14e4583aa004548fd8c23 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:59.415319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757a364-8bc0-4bb4-85fa-f53f2ba12e57 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.415319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757a364-8bc0-4bb4-85fa-f53f2ba12e57 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.415319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757a364-8bc0-4bb4-85fa-f53f2ba12e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.458499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f757a364-8bc0-4bb4-85fa-f53f2ba12e57 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:59.460968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f757a364-8bc0-4bb4-85fa-f53f2ba12e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:59.471733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1030/2056] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:59.473803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b019d0-e4c5-4d7e-97ce-334fda38ca94 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.474113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b019d0-e4c5-4d7e-97ce-334fda38ca94 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.474467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b019d0-e4c5-4d7e-97ce-334fda38ca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.499776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1027/2057] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:40:59 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:40:59.500845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:59.502801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:59.505191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f7b019d0-e4c5-4d7e-97ce-334fda38ca94 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:59.506672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f7b019d0-e4c5-4d7e-97ce-334fda38ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:59.527399 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1031/2058] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:59.528229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b019d0-e4c5-4d7e-97ce-334fda38ca94 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:59.531591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56283c29-b2e9-45a2-86f4-e20074849237 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:59.535804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f7b019d0-e4c5-4d7e-97ce-334fda38ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:59.542398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b9809-2f25-4517-9188-5d947de438c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:59.543921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9809-2f25-4517-9188-5d947de438c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.543921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9809-2f25-4517-9188-5d947de438c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.544084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9809-2f25-4517-9188-5d947de438c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.546230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b9809-2f25-4517-9188-5d947de438c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:59.548685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b9809-2f25-4517-9188-5d947de438c7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:59.575682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1028/2059] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:59.579420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cbb06-dc41-468e-8ac8-7f0b8c8e3bce None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.579420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cbb06-dc41-468e-8ac8-7f0b8c8e3bce None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.579420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cbb06-dc41-468e-8ac8-7f0b8c8e3bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.607745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-052cbb06-dc41-468e-8ac8-7f0b8c8e3bce None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:40:59.609076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-052cbb06-dc41-468e-8ac8-7f0b8c8e3bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:59.619668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1029/2060] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:40:59.621880 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cbb06-dc41-468e-8ac8-7f0b8c8e3bce None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:59.642257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b019d0-e4c5-4d7e-97ce-334fda38ca94 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:59.651092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:59.652927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.653294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.654130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.661161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cbb06-dc41-468e-8ac8-7f0b8c8e3bce None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:59.677722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:59.682561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce374c30-7108-40af-be2b-15f756568d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:59.682811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:59.682897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374c30-7108-40af-be2b-15f756568d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.682897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374c30-7108-40af-be2b-15f756568d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.682897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce374c30-7108-40af-be2b-15f756568d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.682897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce374c30-7108-40af-be2b-15f756568d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:59.683165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce374c30-7108-40af-be2b-15f756568d21 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:59.696751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1032/2061] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:40:59.697927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:59.699300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:40:59.705610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1030/2062] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:40:59.705610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce374c30-7108-40af-be2b-15f756568d21 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:59.719444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568b1b2-004b-4b7d-921c-9909a5fa1afd service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:59.726925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce374c30-7108-40af-be2b-15f756568d21 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:59.730958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:59.730958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.730958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.730958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] PATH_INFO: `/v3/projects/d962400e302d4fe0a1836336ccad40f6` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.731657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d962400e302d4fe0a1836336ccad40f6)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:59.735861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:59.737847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:59.739039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.739317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.739590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.740253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:40:59.740560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:59.742187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:59.766098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1031/2063] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:40:59.766771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:59.792574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87422dd-19e3-46a7-b2f8-a8a513125773 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:40:59.795218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a35d39-8601-491e-afc4-ba708412d016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:40:59.795984 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35d39-8601-491e-afc4-ba708412d016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:40:59.796383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35d39-8601-491e-afc4-ba708412d016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:40:59.796789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35d39-8601-491e-afc4-ba708412d016 admin admin] PATH_INFO: `/v3/projects/1223023afb6847689cc9a33908086c05/users/770b9a33504f4b7aae954c8f2e0550fa/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:40:59.828139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a35d39-8601-491e-afc4-ba708412d016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1223023afb6847689cc9a33908086c05, user_id=770b9a33504f4b7aae954c8f2e0550fa, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:40:59.832427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a35d39-8601-491e-afc4-ba708412d016 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:40:59.968023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1032/2064] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:40:59 2022] PUT /identity/v3/projects/1223023afb6847689cc9a33908086c05/users/770b9a33504f4b7aae954c8f2e0550fa/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:40:59.969260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a35d39-8601-491e-afc4-ba708412d016 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:40:59.979572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd962400e302d4fe0a1836336ccad40f6', 'request_id': 'req-265d8152-c0c6-41fa-8419-19958739c068'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.015392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:00.056923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a35d39-8601-491e-afc4-ba708412d016 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:00.115564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4dd5f-b05a-4e7b-8bc3-c0310ed4c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:00.116174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4dd5f-b05a-4e7b-8bc3-c0310ed4c2bf admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.116454 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4dd5f-b05a-4e7b-8bc3-c0310ed4c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.116725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4dd5f-b05a-4e7b-8bc3-c0310ed4c2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.117359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4dd5f-b05a-4e7b-8bc3-c0310ed4c2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:00.119297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4dd5f-b05a-4e7b-8bc3-c0310ed4c2bf admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:00.163559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd962400e302d4fe0a1836336ccad40f6', 'request_id': 'req-265d8152-c0c6-41fa-8419-19958739c068'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.194440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd962400e302d4fe0a1836336ccad40f6', 'request_id': 'req-265d8152-c0c6-41fa-8419-19958739c068'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.218598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] The token cache is being invalidate because project d962400e302d4fe0a1836336ccad40f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:00.219968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.220381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.226472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1033/2065] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:40:59 2022] DELETE /identity/v3/projects/d962400e302d4fe0a1836336ccad40f6 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:00.226472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:00.228892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.251365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8152-c0c6-41fa-8419-19958739c068 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:00.262980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1033/2066] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:40:59 2022] POST /identity/v3/projects => generated 383 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:00.264337 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db437db-da70-4b7c-9665-07f185271881 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.264631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db437db-da70-4b7c-9665-07f185271881 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.264897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db437db-da70-4b7c-9665-07f185271881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.268891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:00.270203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.270765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.271046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] PATH_INFO: `/v3/projects/c2675e6d5d394d8aaaf7fa10d3159315` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.272238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2675e6d5d394d8aaaf7fa10d3159315)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:00.274227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:00.301358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6db437db-da70-4b7c-9665-07f185271881 None None] MFA Rules not processed for user `770b9a33504f4b7aae954c8f2e0550fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:00.302842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6db437db-da70-4b7c-9665-07f185271881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.370800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1034/2067] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:00.372072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5ed8-1990-41f4-8c3d-d824375866d0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.372357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5ed8-1990-41f4-8c3d-d824375866d0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.376042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5ed8-1990-41f4-8c3d-d824375866d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.392274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1dfe5ed8-1990-41f4-8c3d-d824375866d0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:00.393482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1dfe5ed8-1990-41f4-8c3d-d824375866d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.453231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1035/2068] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:00.454171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5ed8-1990-41f4-8c3d-d824375866d0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:00.456254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1dfe5ed8-1990-41f4-8c3d-d824375866d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.468909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5ed8-1990-41f4-8c3d-d824375866d0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:00.474471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2675e6d5d394d8aaaf7fa10d3159315', 'request_id': 'req-c2e580f8-bc0d-438b-a079-d27632f7a0f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.530237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d0651-b6a1-436d-94ba-ec70e0273424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:00.530784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d0651-b6a1-436d-94ba-ec70e0273424 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.531086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d0651-b6a1-436d-94ba-ec70e0273424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.531356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d0651-b6a1-436d-94ba-ec70e0273424 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.531988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d0651-b6a1-436d-94ba-ec70e0273424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:00.533898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d0651-b6a1-436d-94ba-ec70e0273424 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:00.579445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2675e6d5d394d8aaaf7fa10d3159315', 'request_id': 'req-c2e580f8-bc0d-438b-a079-d27632f7a0f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.585883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2675e6d5d394d8aaaf7fa10d3159315', 'request_id': 'req-c2e580f8-bc0d-438b-a079-d27632f7a0f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.598403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] The token cache is being invalidate because project c2675e6d5d394d8aaaf7fa10d3159315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:00.598695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.599401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:00.601159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1034/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:00 2022] DELETE /identity/v3/projects/c2675e6d5d394d8aaaf7fa10d3159315 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:00.601775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:00.603169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.616549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e580f8-bc0d-438b-a079-d27632f7a0f8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:00.621345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72c1a-9661-454d-a1d6-77ba47372257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:00.621944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72c1a-9661-454d-a1d6-77ba47372257 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.622297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72c1a-9661-454d-a1d6-77ba47372257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.622581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72c1a-9661-454d-a1d6-77ba47372257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.623221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba72c1a-9661-454d-a1d6-77ba47372257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:00.625243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba72c1a-9661-454d-a1d6-77ba47372257 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:00.651202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1036/2070] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:00.655847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa5070-293c-4125-ab89-2fa6523bf192 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.655847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa5070-293c-4125-ab89-2fa6523bf192 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.655847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa5070-293c-4125-ab89-2fa6523bf192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.673432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a0aa5070-293c-4125-ab89-2fa6523bf192 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:00.676909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a0aa5070-293c-4125-ab89-2fa6523bf192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.685326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1037/2071] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:00.686680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048510-ab2d-45c9-8f38-676d05db8bec None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.687031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048510-ab2d-45c9-8f38-676d05db8bec None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.687366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048510-ab2d-45c9-8f38-676d05db8bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.708010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-65048510-ab2d-45c9-8f38-676d05db8bec None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:00.709416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-65048510-ab2d-45c9-8f38-676d05db8bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.724030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1038/2072] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:00.724030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a67f1-8037-4d72-becd-e7c8fc618ed6 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.724030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a67f1-8037-4d72-becd-e7c8fc618ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.724030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a67f1-8037-4d72-becd-e7c8fc618ed6 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.724030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1039/2073] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:41:00.724030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a67f1-8037-4d72-becd-e7c8fc618ed6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:00.724564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f40a67f1-8037-4d72-becd-e7c8fc618ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.731604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1035/2074] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:00.734167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72c1a-9661-454d-a1d6-77ba47372257 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:00.750861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a67f1-8037-4d72-becd-e7c8fc618ed6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:00.802017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72c1a-9661-454d-a1d6-77ba47372257 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:00.808103 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c59055-51c3-44c5-8189-e8d527d602ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:00.808883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c59055-51c3-44c5-8189-e8d527d602ba admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.809012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c59055-51c3-44c5-8189-e8d527d602ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.809306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c59055-51c3-44c5-8189-e8d527d602ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.810439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c59055-51c3-44c5-8189-e8d527d602ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:00.810439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c59055-51c3-44c5-8189-e8d527d602ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:00.811990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c59055-51c3-44c5-8189-e8d527d602ba admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:00.814358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c71eb-d941-4e3b-b232-936926088caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:00.814982 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c71eb-d941-4e3b-b232-936926088caf admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.815292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c71eb-d941-4e3b-b232-936926088caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.815572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c71eb-d941-4e3b-b232-936926088caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.816539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c71eb-d941-4e3b-b232-936926088caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:00.818132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c71eb-d941-4e3b-b232-936926088caf admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:00.828954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1036/2075] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:00.828954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b807-d607-4e09-848f-cee7c96aea70 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.828954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b807-d607-4e09-848f-cee7c96aea70 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.828954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b807-d607-4e09-848f-cee7c96aea70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.836423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1040/2076] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:00.845086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3fccf-6b19-40fe-867f-b624897e635d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.845086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3fccf-6b19-40fe-867f-b624897e635d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.845086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3fccf-6b19-40fe-867f-b624897e635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.853187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-76d9b807-d607-4e09-848f-cee7c96aea70 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:00.854459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-76d9b807-d607-4e09-848f-cee7c96aea70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.859580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a0e3fccf-6b19-40fe-867f-b624897e635d None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:00.860803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a0e3fccf-6b19-40fe-867f-b624897e635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.862754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1037/2077] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:00.863740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b807-d607-4e09-848f-cee7c96aea70 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:00.873279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b807-d607-4e09-848f-cee7c96aea70 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:00.881411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb07fc2-ed96-4573-b9d0-b9111936711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:00.881712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb07fc2-ed96-4573-b9d0-b9111936711a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.882021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb07fc2-ed96-4573-b9d0-b9111936711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.882324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb07fc2-ed96-4573-b9d0-b9111936711a admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.882969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb07fc2-ed96-4573-b9d0-b9111936711a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:00.884923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb07fc2-ed96-4573-b9d0-b9111936711a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:00.931065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1041/2078] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:00.931988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3fccf-6b19-40fe-867f-b624897e635d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:00.933269 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a0e3fccf-6b19-40fe-867f-b624897e635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:00.947747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3fccf-6b19-40fe-867f-b624897e635d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:00.952565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:00.953196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:00.953591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:00.953743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] PATH_INFO: `/v3/users/ddc9556e5f7347948b6f872f1f854665` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:00.954965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc9556e5f7347948b6f872f1f854665)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:00.961143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:00.996573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:01.031178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1038/2079] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:00 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:01.031999 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb07fc2-ed96-4573-b9d0-b9111936711a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.044805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb07fc2-ed96-4573-b9d0-b9111936711a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:01.049784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d80d-8586-4752-9d0b-67163dce9179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:01.050713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d80d-8586-4752-9d0b-67163dce9179 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.051563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d80d-8586-4752-9d0b-67163dce9179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.051849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d80d-8586-4752-9d0b-67163dce9179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.052494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2d80d-8586-4752-9d0b-67163dce9179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:01.054443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2d80d-8586-4752-9d0b-67163dce9179 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:01.283828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1039/2080] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:01 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:01.284729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d80d-8586-4752-9d0b-67163dce9179 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.325755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc9556e5f7347948b6f872f1f854665'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.326430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc9556e5f7347948b6f872f1f854665'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.334025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc9556e5f7347948b6f872f1f854665'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.346186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc9556e5f7347948b6f872f1f854665'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.346996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-188fa697-d836-4193-a2a0-d51a768f9718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc9556e5f7347948b6f872f1f854665'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.349270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d80d-8586-4752-9d0b-67163dce9179 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:01.354178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:01.354810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.355120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.355391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.356061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:01.357639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:01.368432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1040/2081] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:01.369362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.371985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:01.385086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96687d1b-8a91-4102-b218-a05af1612d00 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:01.389717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:01.390346 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.390847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.391118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.391746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:01.392051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:01.393963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:01.408233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1041/2082] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:01.409959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.411131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:01.425967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d6cee-395f-4194-92fa-9f89ccd652cb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:01.431226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:01.433467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.433467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.433467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] PATH_INFO: `/v3/projects/d8c8ae434a3843af86f5f01ee21318a1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.435065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c8ae434a3843af86f5f01ee21318a1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:01.437086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:01.466369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1042/2083] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:00 2022] DELETE /identity/v3/users/ddc9556e5f7347948b6f872f1f854665 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:01.471928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a144-4212-40df-8963-9f1fb8348f81 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.471928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a144-4212-40df-8963-9f1fb8348f81 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.471928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3a144-4212-40df-8963-9f1fb8348f81 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.471928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1043/2084] 10.222.0.16 () {54 vars in 961 bytes} [Thu Sep 22 14:41:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:41:01.472858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3a144-4212-40df-8963-9f1fb8348f81 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.475469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a2c3a144-4212-40df-8963-9f1fb8348f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:01.548732 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3a144-4212-40df-8963-9f1fb8348f81 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:01.554599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:01.555224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.555569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.555847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.556506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:01.558133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:01.572619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1044/2085] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:01.572619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.572619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:01.585192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8132ec-0ff0-4c03-8002-d09748fe930b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:01.586328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c8ae434a3843af86f5f01ee21318a1', 'request_id': 'req-587e9735-1cf5-44f4-b106-848875fd2aa1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.644491 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:01.645113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.645385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.645653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.646332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:01.648331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:01.693856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c8ae434a3843af86f5f01ee21318a1', 'request_id': 'req-587e9735-1cf5-44f4-b106-848875fd2aa1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.700730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c8ae434a3843af86f5f01ee21318a1', 'request_id': 'req-587e9735-1cf5-44f4-b106-848875fd2aa1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.712292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] The token cache is being invalidate because project d8c8ae434a3843af86f5f01ee21318a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:01.712576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.713227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:01.714912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1042/2086] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:01 2022] DELETE /identity/v3/projects/d8c8ae434a3843af86f5f01ee21318a1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:01.717762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.717762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:01.730812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e9735-1cf5-44f4-b106-848875fd2aa1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:01.739136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511787fc-a453-4579-92cf-da8b6ccf6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:01.744088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511787fc-a453-4579-92cf-da8b6ccf6a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.744088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511787fc-a453-4579-92cf-da8b6ccf6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.744088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511787fc-a453-4579-92cf-da8b6ccf6a3e admin admin] PATH_INFO: `/v3/projects/4752d2d4321943f192a96c67753d3f71/users/450d9adcf8dc4a4cb084b8c05c25b464/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.759900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511787fc-a453-4579-92cf-da8b6ccf6a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4752d2d4321943f192a96c67753d3f71, user_id=450d9adcf8dc4a4cb084b8c05c25b464, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:01.762929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511787fc-a453-4579-92cf-da8b6ccf6a3e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:01.804185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1045/2087] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:01 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:01.805000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.806720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:01.818990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55fc01-801a-4383-81d2-21f04465852b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:01.823971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:01.824563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.824840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.825109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.825735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:01.827634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:01.876716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1043/2088] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:01 2022] PUT /identity/v3/projects/4752d2d4321943f192a96c67753d3f71/users/450d9adcf8dc4a4cb084b8c05c25b464/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:01.878089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0488d11-37b9-4156-a3b1-4c2c06d02b14 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:01.878665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0488d11-37b9-4156-a3b1-4c2c06d02b14 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:01.878782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0488d11-37b9-4156-a3b1-4c2c06d02b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:01.899232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e0488d11-37b9-4156-a3b1-4c2c06d02b14 None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:01.900454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e0488d11-37b9-4156-a3b1-4c2c06d02b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:01.965064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1044/2089] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Sep 22 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:01.966883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0488d11-37b9-4156-a3b1-4c2c06d02b14 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:01.968173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e0488d11-37b9-4156-a3b1-4c2c06d02b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.015756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1046/2090] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:01 2022] POST /identity/v3/projects => generated 401 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:02.016743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.018442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.039332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0488d11-37b9-4156-a3b1-4c2c06d02b14 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.087623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb076502-a09c-4eca-9d9b-0bca6fdceb8c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.092395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.093036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.093316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.093596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] PATH_INFO: `/v3/users/12253eb556534575b321a7f8fd254079` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.094791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12253eb556534575b321a7f8fd254079)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.096711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.105132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.105791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.106100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.106374 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] PATH_INFO: `/v3/projects/84975b0d255b42459e36f4dd199221cc/users/37e6327fd4694774801f80203f2fdd11/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.122151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84975b0d255b42459e36f4dd199221cc, user_id=37e6327fd4694774801f80203f2fdd11, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.125291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.237892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1045/2091] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:01 2022] PUT /identity/v3/projects/84975b0d255b42459e36f4dd199221cc/users/37e6327fd4694774801f80203f2fdd11/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:02.239750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.241515 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.309807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d8d0-9c17-4443-8dc3-212ee396c132 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.314949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.315585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.315914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.316369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] PATH_INFO: `/v3/projects/ef192e7d697a46769806184345920ce3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.317679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef192e7d697a46769806184345920ce3)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.319632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.336424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12253eb556534575b321a7f8fd254079'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.337095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12253eb556534575b321a7f8fd254079'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.344518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12253eb556534575b321a7f8fd254079'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.358508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12253eb556534575b321a7f8fd254079'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.359206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12253eb556534575b321a7f8fd254079'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.437398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef192e7d697a46769806184345920ce3', 'request_id': 'req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.460683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1047/2092] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:02 2022] DELETE /identity/v3/users/12253eb556534575b321a7f8fd254079 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:02.464791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.464791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.528496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a516e-59ba-4d58-91e8-d786b8c33f33 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.533406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00f5e3-c6b5-4c13-95a5-90b11161696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.534151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f5e3-c6b5-4c13-95a5-90b11161696e admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.534549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f5e3-c6b5-4c13-95a5-90b11161696e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.534964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f5e3-c6b5-4c13-95a5-90b11161696e admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.535711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00f5e3-c6b5-4c13-95a5-90b11161696e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.537277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00f5e3-c6b5-4c13-95a5-90b11161696e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.547446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1048/2093] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:02.548946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19122c83-b911-408f-aac4-63627a260fef None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.549189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19122c83-b911-408f-aac4-63627a260fef None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.549509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19122c83-b911-408f-aac4-63627a260fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.579818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-19122c83-b911-408f-aac4-63627a260fef None None] MFA Rules not processed for user `450d9adcf8dc4a4cb084b8c05c25b464`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:02.581046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-19122c83-b911-408f-aac4-63627a260fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.613418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef192e7d697a46769806184345920ce3', 'request_id': 'req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.619772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef192e7d697a46769806184345920ce3', 'request_id': 'req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.632227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] The token cache is being invalidate because project ef192e7d697a46769806184345920ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:02.632521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.633186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:02.634735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1046/2094] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:02 2022] DELETE /identity/v3/projects/ef192e7d697a46769806184345920ce3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:02.635504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.640989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.650048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1049/2095] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:02.650879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19122c83-b911-408f-aac4-63627a260fef None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.652208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-19122c83-b911-408f-aac4-63627a260fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.666746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19122c83-b911-408f-aac4-63627a260fef None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.672256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.677047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.677047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.677047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.677047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.677047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.722438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6eb7f-241e-4b04-81a7-a0f0a59a60b6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.787069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.787677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.787956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.788237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.790213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.798024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1050/2096] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:02 2022] POST /identity/v3/users => generated 301 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:02.798728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.802026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.803404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.812923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.815237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432850a1-41e8-40e7-9c0e-dcfa2ead5596 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.816567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1047/2097] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:02.817486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.819054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.822923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d04531-bc36-4261-8d65-aec0dead800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.823666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04531-bc36-4261-8d65-aec0dead800a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.823956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04531-bc36-4261-8d65-aec0dead800a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.824254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04531-bc36-4261-8d65-aec0dead800a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.824966 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d04531-bc36-4261-8d65-aec0dead800a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.826723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d04531-bc36-4261-8d65-aec0dead800a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.833219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b710b1-78c5-442e-b2a0-d67a0f5eacc4 service placement] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.838284 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.838889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.839170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.839446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.840090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.841668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.843618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1051/2098] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:02.845021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032b93-98cf-44a9-ad17-79a86674d032 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.845318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032b93-98cf-44a9-ad17-79a86674d032 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.845593 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb032b93-98cf-44a9-ad17-79a86674d032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.853172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1048/2099] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:02.854492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.866599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.866729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-cb032b93-98cf-44a9-ad17-79a86674d032 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:02.867924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cb032b93-98cf-44a9-ad17-79a86674d032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:02.870898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3914-52e4-44dc-8e39-3c1ef41bf85f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.875844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985688d-8a02-44ec-9759-62caf5af0b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.876148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1052/2100] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:02.876450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985688d-8a02-44ec-9759-62caf5af0b8e admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.876777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985688d-8a02-44ec-9759-62caf5af0b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.876964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032b93-98cf-44a9-ad17-79a86674d032 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.877189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985688d-8a02-44ec-9759-62caf5af0b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.879046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985688d-8a02-44ec-9759-62caf5af0b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.882813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985688d-8a02-44ec-9759-62caf5af0b8e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.888423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb032b93-98cf-44a9-ad17-79a86674d032 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.893259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e117c4-54f7-458c-84ce-d41e96ed860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.893853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e117c4-54f7-458c-84ce-d41e96ed860d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.894859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e117c4-54f7-458c-84ce-d41e96ed860d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.895150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e117c4-54f7-458c-84ce-d41e96ed860d admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.895808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e117c4-54f7-458c-84ce-d41e96ed860d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.897405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e117c4-54f7-458c-84ce-d41e96ed860d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:02.908058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1053/2101] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:02.908847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e117c4-54f7-458c-84ce-d41e96ed860d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:02.918418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e117c4-54f7-458c-84ce-d41e96ed860d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:02.923049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4598e3-49f1-408d-8114-ab6d65b42376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:02.923648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4598e3-49f1-408d-8114-ab6d65b42376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:02.923922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4598e3-49f1-408d-8114-ab6d65b42376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:02.924192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4598e3-49f1-408d-8114-ab6d65b42376 admin admin] PATH_INFO: `/v3/projects/84975b0d255b42459e36f4dd199221cc/users/37e6327fd4694774801f80203f2fdd11/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:02.926845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4598e3-49f1-408d-8114-ab6d65b42376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84975b0d255b42459e36f4dd199221cc, user_id=37e6327fd4694774801f80203f2fdd11, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:02.929426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4598e3-49f1-408d-8114-ab6d65b42376 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.044933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1049/2102] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:02 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:03.046109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985688d-8a02-44ec-9759-62caf5af0b8e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.052011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1054/2103] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:02 2022] PUT /identity/v3/projects/84975b0d255b42459e36f4dd199221cc/users/37e6327fd4694774801f80203f2fdd11/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:03.054065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924d00-353b-4b5f-97fa-2bd4ae6e6848 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.054421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924d00-353b-4b5f-97fa-2bd4ae6e6848 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.054692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff924d00-353b-4b5f-97fa-2bd4ae6e6848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.075407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ff924d00-353b-4b5f-97fa-2bd4ae6e6848 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:03.076734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ff924d00-353b-4b5f-97fa-2bd4ae6e6848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.127169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985688d-8a02-44ec-9759-62caf5af0b8e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.131957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab93d3-20fc-47d1-b9bd-8deeee7e1aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.132674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab93d3-20fc-47d1-b9bd-8deeee7e1aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.132950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab93d3-20fc-47d1-b9bd-8deeee7e1aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.133221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab93d3-20fc-47d1-b9bd-8deeee7e1aa0 admin admin] PATH_INFO: `/v3/projects/7c3cb3919a36440bacf310ed217cdadc/users/c011cfa3d7da4eed834a14221d34d50b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.139414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1055/2104] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:03.140268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924d00-353b-4b5f-97fa-2bd4ae6e6848 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.148332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab93d3-20fc-47d1-b9bd-8deeee7e1aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3cb3919a36440bacf310ed217cdadc, user_id=c011cfa3d7da4eed834a14221d34d50b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.150050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff924d00-353b-4b5f-97fa-2bd4ae6e6848 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.151065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab93d3-20fc-47d1-b9bd-8deeee7e1aa0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.154678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.155399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.155679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.155957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.156621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.158367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.169230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1056/2105] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:03.170249 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.171962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.186344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f106d9-f093-469a-91d2-5c5ea0c70272 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.191113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.191738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.192019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.192289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] PATH_INFO: `/v3/projects/b01a86aa6500480597822841ccca0a90` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.193437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01a86aa6500480597822841ccca0a90)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.195648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.286226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1050/2106] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:03 2022] PUT /identity/v3/projects/7c3cb3919a36440bacf310ed217cdadc/users/c011cfa3d7da4eed834a14221d34d50b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:03.286226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab93d3-20fc-47d1-b9bd-8deeee7e1aa0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.339323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01a86aa6500480597822841ccca0a90', 'request_id': 'req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:03.351572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab93d3-20fc-47d1-b9bd-8deeee7e1aa0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.407736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.408332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.408608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.408879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.409503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.411928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.436786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:03.447853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01a86aa6500480597822841ccca0a90', 'request_id': 'req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:03.455499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01a86aa6500480597822841ccca0a90', 'request_id': 'req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:03.467077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] The token cache is being invalidate because project b01a86aa6500480597822841ccca0a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:03.467416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:03.468104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cbd5c154-b5e1-43ba-ad83-1231e76fd1d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:03.469803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1057/2107] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:03 2022] DELETE /identity/v3/projects/b01a86aa6500480597822841ccca0a90 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:03.471076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89055d-88c0-4182-a0d1-9cc8b63e32a6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.471412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89055d-88c0-4182-a0d1-9cc8b63e32a6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.471681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89055d-88c0-4182-a0d1-9cc8b63e32a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.500293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-cf89055d-88c0-4182-a0d1-9cc8b63e32a6 None None] MFA Rules not processed for user `37e6327fd4694774801f80203f2fdd11`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:03.501503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cf89055d-88c0-4182-a0d1-9cc8b63e32a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.540639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1051/2108] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:03 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:03.544345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.546530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.559333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d89d06-9a1c-4f23-a694-d14e04e514de admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.564224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef0f0f-2024-4a2d-9c60-f1565a631cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.564823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef0f0f-2024-4a2d-9c60-f1565a631cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.565117 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef0f0f-2024-4a2d-9c60-f1565a631cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.565372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef0f0f-2024-4a2d-9c60-f1565a631cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.566182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef0f0f-2024-4a2d-9c60-f1565a631cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:03.566470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef0f0f-2024-4a2d-9c60-f1565a631cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.568051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef0f0f-2024-4a2d-9c60-f1565a631cf1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.571019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1058/2109] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:03.571749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89055d-88c0-4182-a0d1-9cc8b63e32a6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.573020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cf89055d-88c0-4182-a0d1-9cc8b63e32a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.586555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89055d-88c0-4182-a0d1-9cc8b63e32a6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.591009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1052/2110] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:03.591009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c06d5-436a-486c-a869-0da93c5f4a52 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.591009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c06d5-436a-486c-a869-0da93c5f4a52 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.591009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c06d5-436a-486c-a869-0da93c5f4a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.594826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b21487-5b01-4bd1-8af5-29f42d37980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.595484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b21487-5b01-4bd1-8af5-29f42d37980b admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.595761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b21487-5b01-4bd1-8af5-29f42d37980b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.596033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b21487-5b01-4bd1-8af5-29f42d37980b admin admin] PATH_INFO: `/v3/projects/da109146518c41cc8f06e5ab6f2ae2a8/users/fbdc39a09202467bb4f5dec676fb766f/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.611733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b21487-5b01-4bd1-8af5-29f42d37980b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da109146518c41cc8f06e5ab6f2ae2a8, user_id=fbdc39a09202467bb4f5dec676fb766f, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.615987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b21487-5b01-4bd1-8af5-29f42d37980b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.618263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f20c06d5-436a-486c-a869-0da93c5f4a52 None None] MFA Rules not processed for user `c011cfa3d7da4eed834a14221d34d50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:03.619615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f20c06d5-436a-486c-a869-0da93c5f4a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.684826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1053/2111] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:03.686314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb70b1-5065-4264-9c62-d3b225c29ab4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.686603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb70b1-5065-4264-9c62-d3b225c29ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.686882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb70b1-5065-4264-9c62-d3b225c29ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.707213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-86eb70b1-5065-4264-9c62-d3b225c29ab4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:03.708583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-86eb70b1-5065-4264-9c62-d3b225c29ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.716881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1054/2112] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:03.717728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb70b1-5065-4264-9c62-d3b225c29ab4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.719002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-86eb70b1-5065-4264-9c62-d3b225c29ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.731590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb70b1-5065-4264-9c62-d3b225c29ab4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.737233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.737837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.738149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.738428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.739061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.740640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.751273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1055/2113] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:03.752128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.753917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:03.759717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1059/2114] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:03 2022] PUT /identity/v3/projects/da109146518c41cc8f06e5ab6f2ae2a8/users/fbdc39a09202467bb4f5dec676fb766f/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:03.760526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b21487-5b01-4bd1-8af5-29f42d37980b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.814583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef839148-abe6-4b74-8b18-6318a8cefeff admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.832447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b21487-5b01-4bd1-8af5-29f42d37980b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:03.837576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a88d24-c858-417f-8554-cc0eab6199d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.838212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88d24-c858-417f-8554-cc0eab6199d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.838524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88d24-c858-417f-8554-cc0eab6199d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.838797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88d24-c858-417f-8554-cc0eab6199d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.839429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a88d24-c858-417f-8554-cc0eab6199d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.841326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a88d24-c858-417f-8554-cc0eab6199d6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.866043 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:03.866677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:03.866952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:03.867222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:03.927588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:03.929065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:03.938736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1056/2115] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:03.939565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:03.941356 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:04.017062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56707e85-c07f-4c7c-b400-4cdaed51e578 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.021547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d1b1f-abca-4e3c-a674-b517ff9c2767 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dca3ee8b78402eb95815eb200d90a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.022188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1b1f-abca-4e3c-a674-b517ff9c2767 service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.022467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1b1f-abca-4e3c-a674-b517ff9c2767 service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.022744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1b1f-abca-4e3c-a674-b517ff9c2767 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.030718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1060/2116] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:03 2022] POST /identity/v3/projects => generated 389 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:04.030718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa67558-46e4-4baa-ae61-29e20ffa4ead None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.030718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa67558-46e4-4baa-ae61-29e20ffa4ead None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.030718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa67558-46e4-4baa-ae61-29e20ffa4ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.050212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6fa67558-46e4-4baa-ae61-29e20ffa4ead None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:04.051447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6fa67558-46e4-4baa-ae61-29e20ffa4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:04.086724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d1b1f-abca-4e3c-a674-b517ff9c2767 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.086724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d1b1f-abca-4e3c-a674-b517ff9c2767 service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.094087 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1057/2117] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:04.094994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d1b1f-abca-4e3c-a674-b517ff9c2767 service glance] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.106961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d1b1f-abca-4e3c-a674-b517ff9c2767 service glance] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.112446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f206-3f7d-4ed0-a045-62a9a74a76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.113545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f206-3f7d-4ed0-a045-62a9a74a76fb admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.113545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f206-3f7d-4ed0-a045-62a9a74a76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.113545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f206-3f7d-4ed0-a045-62a9a74a76fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.114187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1061/2118] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:04.115618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb33f-89a6-4177-85ce-9bf424709d37 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.116008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb33f-89a6-4177-85ce-9bf424709d37 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.116374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0eb33f-89a6-4177-85ce-9bf424709d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.117542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f206-3f7d-4ed0-a045-62a9a74a76fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.119128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f206-3f7d-4ed0-a045-62a9a74a76fb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.132992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1058/2119] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:04.133746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f206-3f7d-4ed0-a045-62a9a74a76fb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.155334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f206-3f7d-4ed0-a045-62a9a74a76fb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.155430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9d0eb33f-89a6-4177-85ce-9bf424709d37 None None] MFA Rules not processed for user `fbdc39a09202467bb4f5dec676fb766f`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:04.155430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9d0eb33f-89a6-4177-85ce-9bf424709d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:04.155577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059201d-79a2-458b-956a-6046e6b0c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.155577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059201d-79a2-458b-956a-6046e6b0c62b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.155577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059201d-79a2-458b-956a-6046e6b0c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.155577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059201d-79a2-458b-956a-6046e6b0c62b admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.155896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059201d-79a2-458b-956a-6046e6b0c62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.155896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059201d-79a2-458b-956a-6046e6b0c62b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.221725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1062/2120] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:04.222791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0eb33f-89a6-4177-85ce-9bf424709d37 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.238516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0eb33f-89a6-4177-85ce-9bf424709d37 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.240138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.240883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.241223 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.241563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.242326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:04.242697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.244371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.257237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1063/2121] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:04.258132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.268114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a1dc5-9d97-48df-8152-a7c3b8b24fce admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.274526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542a53-af3c-419a-858d-4d7d7b96498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.275386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542a53-af3c-419a-858d-4d7d7b96498b admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.275675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542a53-af3c-419a-858d-4d7d7b96498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.275965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64542a53-af3c-419a-858d-4d7d7b96498b admin admin] PATH_INFO: `/v3/projects/8c6c355c56b0407c97f95f282dfd8eb7/users/3cae7c26a6a54de38cecf676ec6aa711/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.293735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64542a53-af3c-419a-858d-4d7d7b96498b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6c355c56b0407c97f95f282dfd8eb7, user_id=3cae7c26a6a54de38cecf676ec6aa711, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.297182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64542a53-af3c-419a-858d-4d7d7b96498b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.345459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1059/2122] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:04.346275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059201d-79a2-458b-956a-6046e6b0c62b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.402470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1064/2123] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:04 2022] PUT /identity/v3/projects/8c6c355c56b0407c97f95f282dfd8eb7/users/3cae7c26a6a54de38cecf676ec6aa711/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:04.403321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542a53-af3c-419a-858d-4d7d7b96498b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.403673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059201d-79a2-458b-956a-6046e6b0c62b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.459768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.460377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.460652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.460923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.462693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:04.475946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64542a53-af3c-419a-858d-4d7d7b96498b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.480629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade89f-6b0a-4e6a-a8fe-9b09786c9fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.481238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade89f-6b0a-4e6a-a8fe-9b09786c9fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.481516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade89f-6b0a-4e6a-a8fe-9b09786c9fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.482181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ade89f-6b0a-4e6a-a8fe-9b09786c9fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.482819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade89f-6b0a-4e6a-a8fe-9b09786c9fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.484721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ade89f-6b0a-4e6a-a8fe-9b09786c9fd4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.533186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.535271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.544593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1060/2124] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:04.545413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.556706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715621c-bd19-4741-b876-8bcca411725a service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.561507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be550816-ff7d-4a2c-9bc2-bc77fde37323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.562155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550816-ff7d-4a2c-9bc2-bc77fde37323 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.562438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550816-ff7d-4a2c-9bc2-bc77fde37323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.562713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550816-ff7d-4a2c-9bc2-bc77fde37323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.563361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be550816-ff7d-4a2c-9bc2-bc77fde37323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.565256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be550816-ff7d-4a2c-9bc2-bc77fde37323 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.624963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1065/2125] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/projects => generated 401 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:04.624963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade89f-6b0a-4e6a-a8fe-9b09786c9fd4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.686286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ade89f-6b0a-4e6a-a8fe-9b09786c9fd4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.691190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02433cf-998a-4465-be14-6f3e28f5710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.691790 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02433cf-998a-4465-be14-6f3e28f5710e admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.692066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02433cf-998a-4465-be14-6f3e28f5710e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.692335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02433cf-998a-4465-be14-6f3e28f5710e admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.692976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02433cf-998a-4465-be14-6f3e28f5710e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.694842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02433cf-998a-4465-be14-6f3e28f5710e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.704385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1066/2126] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:04.705590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865b08-02a4-499e-82ca-2d6b35facfab None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.705873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865b08-02a4-499e-82ca-2d6b35facfab None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.706184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79865b08-02a4-499e-82ca-2d6b35facfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.733569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-79865b08-02a4-499e-82ca-2d6b35facfab None None] MFA Rules not processed for user `3cae7c26a6a54de38cecf676ec6aa711`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:04.734809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-79865b08-02a4-499e-82ca-2d6b35facfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:04.774747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1061/2127] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:04.774747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be550816-ff7d-4a2c-9bc2-bc77fde37323 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.808127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1067/2128] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:04.808127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865b08-02a4-499e-82ca-2d6b35facfab None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.823629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79865b08-02a4-499e-82ca-2d6b35facfab None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.848626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be550816-ff7d-4a2c-9bc2-bc77fde37323 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.856304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21381c9-52bb-4930-8b2a-47ef2b80c9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.856921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21381c9-52bb-4930-8b2a-47ef2b80c9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.857200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21381c9-52bb-4930-8b2a-47ef2b80c9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.857474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21381c9-52bb-4930-8b2a-47ef2b80c9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.858313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21381c9-52bb-4930-8b2a-47ef2b80c9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.860119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21381c9-52bb-4930-8b2a-47ef2b80c9d1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.895492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc1449-2aac-441d-b4d3-53e840a8f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.895492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1449-2aac-441d-b4d3-53e840a8f853 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.895492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1449-2aac-441d-b4d3-53e840a8f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.895492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1449-2aac-441d-b4d3-53e840a8f853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.896295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc1449-2aac-441d-b4d3-53e840a8f853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.896295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc1449-2aac-441d-b4d3-53e840a8f853 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.904486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1068/2129] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:04.905441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc1449-2aac-441d-b4d3-53e840a8f853 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:04.915819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc1449-2aac-441d-b4d3-53e840a8f853 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:04.920510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55f492-7554-4987-b638-5df342b80cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:04.921086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55f492-7554-4987-b638-5df342b80cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:04.921364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55f492-7554-4987-b638-5df342b80cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:04.921637 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55f492-7554-4987-b638-5df342b80cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:04.922292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55f492-7554-4987-b638-5df342b80cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:04.924180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55f492-7554-4987-b638-5df342b80cd4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:04.991623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1062/2130] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/users => generated 307 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:04.991623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21381c9-52bb-4930-8b2a-47ef2b80c9d1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.001960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21381c9-52bb-4930-8b2a-47ef2b80c9d1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.006752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470c22-3aa9-4fd3-afdf-8848f77ed583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.007365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470c22-3aa9-4fd3-afdf-8848f77ed583 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.007660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470c22-3aa9-4fd3-afdf-8848f77ed583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.007949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470c22-3aa9-4fd3-afdf-8848f77ed583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.008565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8470c22-3aa9-4fd3-afdf-8848f77ed583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.010514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8470c22-3aa9-4fd3-afdf-8848f77ed583 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.111216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1069/2131] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:05.112168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55f492-7554-4987-b638-5df342b80cd4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.121915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55f492-7554-4987-b638-5df342b80cd4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.126745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86147-3511-4bcb-9c7a-7f063d62d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.127374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86147-3511-4bcb-9c7a-7f063d62d02f admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.127653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86147-3511-4bcb-9c7a-7f063d62d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.127924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86147-3511-4bcb-9c7a-7f063d62d02f admin admin] PATH_INFO: `/v3/projects/c6d98d531c33471793143c5945f1d3a9/users/2b0375d6cd584faeab759ff9f5cd98f8/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.146003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a86147-3511-4bcb-9c7a-7f063d62d02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d98d531c33471793143c5945f1d3a9, user_id=2b0375d6cd584faeab759ff9f5cd98f8, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.148527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1063/2132] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:04 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:05.148976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a86147-3511-4bcb-9c7a-7f063d62d02f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.153695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470c22-3aa9-4fd3-afdf-8848f77ed583 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.219227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470c22-3aa9-4fd3-afdf-8848f77ed583 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.224548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b5e6-757b-4bea-b090-23f7b2f92eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.225172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b5e6-757b-4bea-b090-23f7b2f92eff admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.225440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b5e6-757b-4bea-b090-23f7b2f92eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.225713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b5e6-757b-4bea-b090-23f7b2f92eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.226397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b5e6-757b-4bea-b090-23f7b2f92eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.230615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b5e6-757b-4bea-b090-23f7b2f92eff admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.238528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1064/2133] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:05.239363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b5e6-757b-4bea-b090-23f7b2f92eff admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.249359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b5e6-757b-4bea-b090-23f7b2f92eff admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.254129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499b4cf-3101-4ca6-8bc0-7f9e140c9e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.254717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499b4cf-3101-4ca6-8bc0-7f9e140c9e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.254991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499b4cf-3101-4ca6-8bc0-7f9e140c9e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.255260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499b4cf-3101-4ca6-8bc0-7f9e140c9e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.255886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499b4cf-3101-4ca6-8bc0-7f9e140c9e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.257464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499b4cf-3101-4ca6-8bc0-7f9e140c9e2f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.265824 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1070/2134] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:05 2022] PUT /identity/v3/projects/c6d98d531c33471793143c5945f1d3a9/users/2b0375d6cd584faeab759ff9f5cd98f8/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:05.266677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86147-3511-4bcb-9c7a-7f063d62d02f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.268072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1065/2135] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:05.268840 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499b4cf-3101-4ca6-8bc0-7f9e140c9e2f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.280431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499b4cf-3101-4ca6-8bc0-7f9e140c9e2f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.334499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:05.353292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dfdce-a4a7-4c49-a1fd-d5394501022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.354225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfdce-a4a7-4c49-a1fd-d5394501022e admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.354507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfdce-a4a7-4c49-a1fd-d5394501022e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.354785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfdce-a4a7-4c49-a1fd-d5394501022e admin admin] PATH_INFO: `/v3/projects/eeba2f74cad842c0980d80babb2e1e5b/users/d082fa4b29964a3f84a7306d2ac5983b/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.358050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86147-3511-4bcb-9c7a-7f063d62d02f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.363189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83e1ef-b1e4-4dea-8f06-fa95b32bf22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.363886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e1ef-b1e4-4dea-8f06-fa95b32bf22a admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.364166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e1ef-b1e4-4dea-8f06-fa95b32bf22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.364437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e1ef-b1e4-4dea-8f06-fa95b32bf22a admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.365065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83e1ef-b1e4-4dea-8f06-fa95b32bf22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.367012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83e1ef-b1e4-4dea-8f06-fa95b32bf22a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.370495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dfdce-a4a7-4c49-a1fd-d5394501022e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeba2f74cad842c0980d80babb2e1e5b, user_id=d082fa4b29964a3f84a7306d2ac5983b, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.373377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62dfdce-a4a7-4c49-a1fd-d5394501022e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.494355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1071/2136] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:05 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:05.495733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3e78-947a-46eb-b916-b88b7107b8a4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.496084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3e78-947a-46eb-b916-b88b7107b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.496529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc3e78-947a-46eb-b916-b88b7107b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.501517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1066/2137] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:05 2022] PUT /identity/v3/projects/eeba2f74cad842c0980d80babb2e1e5b/users/d082fa4b29964a3f84a7306d2ac5983b/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:05.504745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dfdce-a4a7-4c49-a1fd-d5394501022e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.521323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-99bc3e78-947a-46eb-b916-b88b7107b8a4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:05.522782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-99bc3e78-947a-46eb-b916-b88b7107b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:05.582643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dfdce-a4a7-4c49-a1fd-d5394501022e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.587637 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce10b2-59a1-4e95-a160-f7d710020285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.588321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce10b2-59a1-4e95-a160-f7d710020285 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.588672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce10b2-59a1-4e95-a160-f7d710020285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.588945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce10b2-59a1-4e95-a160-f7d710020285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.589586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce10b2-59a1-4e95-a160-f7d710020285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.591193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce10b2-59a1-4e95-a160-f7d710020285 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.594182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1072/2138] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:05.595089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc3e78-947a-46eb-b916-b88b7107b8a4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.604311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1067/2139] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:05.604311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce10b2-59a1-4e95-a160-f7d710020285 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.610225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc3e78-947a-46eb-b916-b88b7107b8a4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.614224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce10b2-59a1-4e95-a160-f7d710020285 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.616112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.616722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.616997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.617266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.617922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.619260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f471d-c0df-4269-b19f-a17e7918f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.619534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.619987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f471d-c0df-4269-b19f-a17e7918f42d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.620332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f471d-c0df-4269-b19f-a17e7918f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.620674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f471d-c0df-4269-b19f-a17e7918f42d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.621319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f471d-c0df-4269-b19f-a17e7918f42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.622916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f471d-c0df-4269-b19f-a17e7918f42d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.630096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1073/2140] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:05.630912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.632619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:05.633805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1068/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:05.635179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f471d-c0df-4269-b19f-a17e7918f42d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.646761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f471d-c0df-4269-b19f-a17e7918f42d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.651619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bcd07-13a7-48c6-9a87-2a5ef318d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.652588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bcd07-13a7-48c6-9a87-2a5ef318d9da admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.652869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bcd07-13a7-48c6-9a87-2a5ef318d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.653138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bcd07-13a7-48c6-9a87-2a5ef318d9da admin admin] PATH_INFO: `/v3/projects/87e4c587ea064fa195b5254145a298dd/users/1442b821666f4ccaae31dfdeb0985945/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.669258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bcd07-13a7-48c6-9a87-2a5ef318d9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e4c587ea064fa195b5254145a298dd, user_id=1442b821666f4ccaae31dfdeb0985945, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.672086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bcd07-13a7-48c6-9a87-2a5ef318d9da admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.710905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b739b98-69bd-4389-966a-15617567fe91 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.715229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0900f-4dc9-4880-ad38-3d9d6bf611ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.715887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0900f-4dc9-4880-ad38-3d9d6bf611ae service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.716219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0900f-4dc9-4880-ad38-3d9d6bf611ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.716498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0900f-4dc9-4880-ad38-3d9d6bf611ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.727215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0900f-4dc9-4880-ad38-3d9d6bf611ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.728566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0900f-4dc9-4880-ad38-3d9d6bf611ae service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.739553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1074/2142] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:05.740380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0900f-4dc9-4880-ad38-3d9d6bf611ae service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.749407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0900f-4dc9-4880-ad38-3d9d6bf611ae service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.754879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ac9e9-ad22-4daa-b370-b30f0d9cc92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.755500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac9e9-ad22-4daa-b370-b30f0d9cc92a admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.756411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac9e9-ad22-4daa-b370-b30f0d9cc92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.756411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ac9e9-ad22-4daa-b370-b30f0d9cc92a admin admin] PATH_INFO: `/v3/projects/8617ae3161254a73a96eb472046e6903/users/ddf04699bb384fdf837e295aa2bda35e/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.774116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ac9e9-ad22-4daa-b370-b30f0d9cc92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8617ae3161254a73a96eb472046e6903, user_id=ddf04699bb384fdf837e295aa2bda35e, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.775305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1069/2143] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:05 2022] PUT /identity/v3/projects/87e4c587ea064fa195b5254145a298dd/users/1442b821666f4ccaae31dfdeb0985945/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:05.776185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bcd07-13a7-48c6-9a87-2a5ef318d9da admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:05.776998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ac9e9-ad22-4daa-b370-b30f0d9cc92a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.851974 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bcd07-13a7-48c6-9a87-2a5ef318d9da admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:05.856883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34da410-6e6a-413f-a765-62a15406b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:05.857545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34da410-6e6a-413f-a765-62a15406b0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.857870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34da410-6e6a-413f-a765-62a15406b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.858189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34da410-6e6a-413f-a765-62a15406b0b5 admin admin] PATH_INFO: `/v3/projects/eeba2f74cad842c0980d80babb2e1e5b/users/d082fa4b29964a3f84a7306d2ac5983b/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.860088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34da410-6e6a-413f-a765-62a15406b0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeba2f74cad842c0980d80babb2e1e5b, user_id=d082fa4b29964a3f84a7306d2ac5983b, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:05.862788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34da410-6e6a-413f-a765-62a15406b0b5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:05.878347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1070/2144] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:05 2022] PUT /identity/v3/projects/eeba2f74cad842c0980d80babb2e1e5b/users/d082fa4b29964a3f84a7306d2ac5983b/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:05.878347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d408df-8f13-41d8-bf95-57c6caeb8197 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.878347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d408df-8f13-41d8-bf95-57c6caeb8197 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.878347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d408df-8f13-41d8-bf95-57c6caeb8197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.892049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1075/2145] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:05 2022] PUT /identity/v3/projects/8617ae3161254a73a96eb472046e6903/users/ddf04699bb384fdf837e295aa2bda35e/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:05.893629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d5c91-165e-473c-ba6b-32a30282d8aa None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:05.894612 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d5c91-165e-473c-ba6b-32a30282d8aa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:05.895409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d5c91-165e-473c-ba6b-32a30282d8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:05.908925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-20d408df-8f13-41d8-bf95-57c6caeb8197 None None] MFA Rules not processed for user `1442b821666f4ccaae31dfdeb0985945`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:05.910802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-20d408df-8f13-41d8-bf95-57c6caeb8197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:05.926746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a83d5c91-165e-473c-ba6b-32a30282d8aa None None] MFA Rules not processed for user `d082fa4b29964a3f84a7306d2ac5983b`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:05.928074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a83d5c91-165e-473c-ba6b-32a30282d8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:06.005276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1071/2146] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:06.006430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d408df-8f13-41d8-bf95-57c6caeb8197 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:06.018473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1076/2147] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:05 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:06.019706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d5c91-165e-473c-ba6b-32a30282d8aa None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:06.090021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d5c91-165e-473c-ba6b-32a30282d8aa None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:06.092941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d408df-8f13-41d8-bf95-57c6caeb8197 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:06.093909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:06.094597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:06.094876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:06.095138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:06.100179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1750cb-baca-4b80-8e2c-5d79f2feff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:06.100887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1750cb-baca-4b80-8e2c-5d79f2feff1e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:06.101240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1750cb-baca-4b80-8e2c-5d79f2feff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:06.101584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1750cb-baca-4b80-8e2c-5d79f2feff1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:06.102448 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1750cb-baca-4b80-8e2c-5d79f2feff1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:06.104720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:06.105444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1750cb-baca-4b80-8e2c-5d79f2feff1e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:06.106179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:06.116814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1077/2148] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:06.117668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:06.123704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:06.123947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1072/2149] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:06.126411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1750cb-baca-4b80-8e2c-5d79f2feff1e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:06.138004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665d03-d525-4081-8f0a-6ba3fb6a0415 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:06.139262 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc2089-c9bf-4ee7-ae90-f8477dcbb755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:06.139877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc2089-c9bf-4ee7-ae90-f8477dcbb755 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:06.140159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc2089-c9bf-4ee7-ae90-f8477dcbb755 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:06.140483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc2089-c9bf-4ee7-ae90-f8477dcbb755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:06.150353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1750cb-baca-4b80-8e2c-5d79f2feff1e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:06.168692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db372d5e-dfc5-41b8-9e84-3adfbfb8e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:06.169847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db372d5e-dfc5-41b8-9e84-3adfbfb8e4a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:06.170344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db372d5e-dfc5-41b8-9e84-3adfbfb8e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:06.170911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db372d5e-dfc5-41b8-9e84-3adfbfb8e4a8 admin admin] PATH_INFO: `/v3/projects/8617ae3161254a73a96eb472046e6903/users/ddf04699bb384fdf837e295aa2bda35e/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:06.174362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc2089-c9bf-4ee7-ae90-f8477dcbb755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:06.176598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db372d5e-dfc5-41b8-9e84-3adfbfb8e4a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8617ae3161254a73a96eb472046e6903, user_id=ddf04699bb384fdf837e295aa2bda35e, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:06.179088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc2089-c9bf-4ee7-ae90-f8477dcbb755 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:06.180866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db372d5e-dfc5-41b8-9e84-3adfbfb8e4a8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:06.186290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:06.221719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1078/2150] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:06 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:06.237312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1073/2151] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:06 2022] PUT /identity/v3/projects/8617ae3161254a73a96eb472046e6903/users/ddf04699bb384fdf837e295aa2bda35e/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:06.260277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab604-d554-40cc-a0ca-d573a0b6c8c1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:06.260277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab604-d554-40cc-a0ca-d573a0b6c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:06.260541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab604-d554-40cc-a0ca-d573a0b6c8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:06.298957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-364ab604-d554-40cc-a0ca-d573a0b6c8c1 None None] MFA Rules not processed for user `ddf04699bb384fdf837e295aa2bda35e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:06.300310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-364ab604-d554-40cc-a0ca-d573a0b6c8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:06.388191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1079/2152] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:06.534546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db372d5e-dfc5-41b8-9e84-3adfbfb8e4a8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:06.605667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db372d5e-dfc5-41b8-9e84-3adfbfb8e4a8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:06.610541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:06.611225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:06.611570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:06.611842 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:06.613801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:06.691702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:06.693702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:06.706817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1074/2153] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:07.351556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab604-d554-40cc-a0ca-d573a0b6c8c1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:07.361248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab604-d554-40cc-a0ca-d573a0b6c8c1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:07.365960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388d70-4b8f-4aed-8b65-850a48b0ad86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:07.366697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388d70-4b8f-4aed-8b65-850a48b0ad86 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:07.366972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388d70-4b8f-4aed-8b65-850a48b0ad86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:07.367241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94388d70-4b8f-4aed-8b65-850a48b0ad86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:07.427128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94388d70-4b8f-4aed-8b65-850a48b0ad86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:07.428872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94388d70-4b8f-4aed-8b65-850a48b0ad86 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:07.439192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1080/2154] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:07 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:09.099981 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:09.308006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:09.326036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58060c40-566d-4984-93ac-194a9a44cfdc service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:09.328098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:09.328829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:09.329215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:09.329550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:09.411221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:09.412802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:09.424303 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1075/2155] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:10.203397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:10.368420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388d70-4b8f-4aed-8b65-850a48b0ad86 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:10.482374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94388d70-4b8f-4aed-8b65-850a48b0ad86 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:10.482374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:10.482374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:10.482374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:10.482663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] PATH_INFO: `/v3/users/1442b821666f4ccaae31dfdeb0985945` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:10.482663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1442b821666f4ccaae31dfdeb0985945)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:10.482663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:10.624753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:10.626599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:10.647933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee99e7f-d564-41f4-9142-79987563a17c service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:10.653071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:10.654111 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:10.654614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:10.655076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] PATH_INFO: `/v3/users/215a13dbdf134d16a940a903c989f1a4` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:10.656424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215a13dbdf134d16a940a903c989f1a4)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:10.658755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:10.698173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1442b821666f4ccaae31dfdeb0985945'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:10.698941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1442b821666f4ccaae31dfdeb0985945'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:10.716377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1442b821666f4ccaae31dfdeb0985945'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:10.741439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1442b821666f4ccaae31dfdeb0985945'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:10.742749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6d08b860-74f7-41a5-aca6-35aa8c0597ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1442b821666f4ccaae31dfdeb0985945'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:10.831031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1081/2156] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:10 2022] DELETE /identity/v3/users/1442b821666f4ccaae31dfdeb0985945 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:10.833239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bafbe9-0167-412d-89ee-8cd552edc975 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:10.833517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bafbe9-0167-412d-89ee-8cd552edc975 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:10.834143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bafbe9-0167-412d-89ee-8cd552edc975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:10.859062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-29bafbe9-0167-412d-89ee-8cd552edc975 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:10.862948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-29bafbe9-0167-412d-89ee-8cd552edc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:10.916690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215a13dbdf134d16a940a903c989f1a4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:10.946918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215a13dbdf134d16a940a903c989f1a4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:10.980495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1082/2157] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:10.993513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bafbe9-0167-412d-89ee-8cd552edc975 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:10.995001 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-29bafbe9-0167-412d-89ee-8cd552edc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:11.080145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bafbe9-0167-412d-89ee-8cd552edc975 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:11.085620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfc19-042e-49cd-9b69-055e9c7c9098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:11.086634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfc19-042e-49cd-9b69-055e9c7c9098 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:11.087197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfc19-042e-49cd-9b69-055e9c7c9098 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:11.087704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dfc19-042e-49cd-9b69-055e9c7c9098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:11.099466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215a13dbdf134d16a940a903c989f1a4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:11.100515 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215a13dbdf134d16a940a903c989f1a4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:11.106573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dfc19-042e-49cd-9b69-055e9c7c9098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:11.110231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dfc19-042e-49cd-9b69-055e9c7c9098 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:11.110870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a4fe22b7-f6a7-4b75-91ac-cd5bfd335687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215a13dbdf134d16a940a903c989f1a4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:11.123725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1076/2158] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:10 2022] DELETE /identity/v3/users/215a13dbdf134d16a940a903c989f1a4 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:11.128728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b04a92-4c20-44fd-a7b0-b86636210546 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:11.129439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b04a92-4c20-44fd-a7b0-b86636210546 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:11.129927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b04a92-4c20-44fd-a7b0-b86636210546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:11.137141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1083/2159] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:41:11.156962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e9b04a92-4c20-44fd-a7b0-b86636210546 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:11.158733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e9b04a92-4c20-44fd-a7b0-b86636210546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:11.293701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1077/2160] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:11.300973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfc19-042e-49cd-9b69-055e9c7c9098 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:11.312929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dfc19-042e-49cd-9b69-055e9c7c9098 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:11.376456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:11.377351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:11.382134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:11.382535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:11.413952 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:11.417081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:11.448643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1084/2161] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:11.937132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b04a92-4c20-44fd-a7b0-b86636210546 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:11.953126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e9b04a92-4c20-44fd-a7b0-b86636210546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:11.984684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b04a92-4c20-44fd-a7b0-b86636210546 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:12.005476 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:12.008220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:12.009044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:12.010257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] PATH_INFO: `/v3/projects/87e4c587ea064fa195b5254145a298dd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:12.014936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e4c587ea064fa195b5254145a298dd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:12.018543 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:12.221182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e4c587ea064fa195b5254145a298dd', 'request_id': 'req-3d68eac6-ef99-4c5d-9812-2131404ac4c8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.313791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:12.321208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:12.335579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cefea-a3a2-40a0-b7af-d0da3d666014 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:12.346160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e4c587ea064fa195b5254145a298dd', 'request_id': 'req-3d68eac6-ef99-4c5d-9812-2131404ac4c8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.364675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e4c587ea064fa195b5254145a298dd', 'request_id': 'req-3d68eac6-ef99-4c5d-9812-2131404ac4c8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.398035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] The token cache is being invalidate because project 87e4c587ea064fa195b5254145a298dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:12.398579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.399834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.402368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:12.412374 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1078/2162] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:11 2022] DELETE /identity/v3/projects/87e4c587ea064fa195b5254145a298dd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:12.412374 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:12.415799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:12.496665 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:12.497411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:12.497765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:12.497999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] PATH_INFO: `/v3/projects/33fd87484ee4468eb288821d3885b8ba` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:12.499312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fd87484ee4468eb288821d3885b8ba)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:12.502133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:12.553919 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68eac6-ef99-4c5d-9812-2131404ac4c8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:12.562713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc7898-d291-45e2-a179-fb898a3f0b87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:12.563823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7898-d291-45e2-a179-fb898a3f0b87 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:12.564294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7898-d291-45e2-a179-fb898a3f0b87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:12.564666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc7898-d291-45e2-a179-fb898a3f0b87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:12.568519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4afc7898-d291-45e2-a179-fb898a3f0b87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:12.667648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fd87484ee4468eb288821d3885b8ba', 'request_id': 'req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.685187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc7898-d291-45e2-a179-fb898a3f0b87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:12.687294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc7898-d291-45e2-a179-fb898a3f0b87 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:12.705210 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1079/2163] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:12.710194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44df24-1515-4401-aa30-2674e182824f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:12.710484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44df24-1515-4401-aa30-2674e182824f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:12.710755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44df24-1515-4401-aa30-2674e182824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:12.741162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-eb44df24-1515-4401-aa30-2674e182824f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:12.742641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-eb44df24-1515-4401-aa30-2674e182824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:12.791831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fd87484ee4468eb288821d3885b8ba', 'request_id': 'req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.805032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fd87484ee4468eb288821d3885b8ba', 'request_id': 'req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.826710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] The token cache is being invalidate because project 33fd87484ee4468eb288821d3885b8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:12.828071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.829082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:12.834410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1085/2164] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:12 2022] DELETE /identity/v3/projects/33fd87484ee4468eb288821d3885b8ba => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:12.838249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1080/2165] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:12.845004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:12.845960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059de98-f9d2-4b9d-9b75-c09bab4a2fd3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:12.847556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:12.848119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059de98-f9d2-4b9d-9b75-c09bab4a2fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:12.848687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059de98-f9d2-4b9d-9b75-c09bab4a2fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:12.868096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218bb51-0a8d-42e0-9b25-bbbccb5a5354 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:12.871996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7059de98-f9d2-4b9d-9b75-c09bab4a2fd3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:12.873317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7059de98-f9d2-4b9d-9b75-c09bab4a2fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:12.880850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:12.906821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:12.907381 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:12.908181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] PATH_INFO: `/v3/users/770b9a33504f4b7aae954c8f2e0550fa` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:12.913878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=770b9a33504f4b7aae954c8f2e0550fa)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:12.918730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:12.932891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1081/2166] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:12.936414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059de98-f9d2-4b9d-9b75-c09bab4a2fd3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:12.953353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059de98-f9d2-4b9d-9b75-c09bab4a2fd3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:12.963527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:12.964734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:12.965227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:12.976222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:12.984426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:12.984426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:12.984426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:12.999454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1082/2167] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:13.004943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:13.030366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6297d6-828c-4290-8b4d-91d92badd58d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:13.030366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daeab4-334c-4d9c-b1c0-54cc825ea669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:13.030366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daeab4-334c-4d9c-b1c0-54cc825ea669 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:13.030366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daeab4-334c-4d9c-b1c0-54cc825ea669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:13.030775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daeab4-334c-4d9c-b1c0-54cc825ea669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:13.030775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daeab4-334c-4d9c-b1c0-54cc825ea669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:13.030775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daeab4-334c-4d9c-b1c0-54cc825ea669 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:13.202065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1083/2168] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:13 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:13.202065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d2c64-b689-422a-b3a8-6c2959edfe97 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:13.202065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d2c64-b689-422a-b3a8-6c2959edfe97 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:13.202065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d2c64-b689-422a-b3a8-6c2959edfe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:13.243219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770b9a33504f4b7aae954c8f2e0550fa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:13.244145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770b9a33504f4b7aae954c8f2e0550fa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:13.247499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-809d2c64-b689-422a-b3a8-6c2959edfe97 None None] MFA Rules not processed for user `2b0375d6cd584faeab759ff9f5cd98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:13.249646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-809d2c64-b689-422a-b3a8-6c2959edfe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:13.254634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770b9a33504f4b7aae954c8f2e0550fa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:13.270878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770b9a33504f4b7aae954c8f2e0550fa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:13.272130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770b9a33504f4b7aae954c8f2e0550fa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:13.337718 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1084/2169] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:13.338834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d2c64-b689-422a-b3a8-6c2959edfe97 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:13.340337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-809d2c64-b689-422a-b3a8-6c2959edfe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:13.356093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1086/2170] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:12 2022] DELETE /identity/v3/users/770b9a33504f4b7aae954c8f2e0550fa => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:13.357422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:13.360653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:13.437883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d2c64-b689-422a-b3a8-6c2959edfe97 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:13.484214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:13.522097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6c23d-8bef-480e-86f1-9cba9940dcbb admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:13.538557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b232d-fb2e-4059-bc46-87d61b8d04b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:13.539263 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b232d-fb2e-4059-bc46-87d61b8d04b2 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:13.539723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b232d-fb2e-4059-bc46-87d61b8d04b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:13.539996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b232d-fb2e-4059-bc46-87d61b8d04b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:13.568909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fb767-b5bc-4a03-a71c-be0a4f35f169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:13.569832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fb767-b5bc-4a03-a71c-be0a4f35f169 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:13.570148 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fb767-b5bc-4a03-a71c-be0a4f35f169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:13.570422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fb767-b5bc-4a03-a71c-be0a4f35f169 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:13.571076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fb767-b5bc-4a03-a71c-be0a4f35f169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:13.573014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fb767-b5bc-4a03-a71c-be0a4f35f169 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:13.626574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b232d-fb2e-4059-bc46-87d61b8d04b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:13.629827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b232d-fb2e-4059-bc46-87d61b8d04b2 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:13.641564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1087/2171] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:13.764953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1085/2172] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:13 2022] POST /identity/v3/users => generated 288 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:13.771028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b232d-fb2e-4059-bc46-87d61b8d04b2 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:13.783640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b232d-fb2e-4059-bc46-87d61b8d04b2 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:13.789129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c3872-87c2-4c0c-9e06-38fb1e617a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:13.789838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c3872-87c2-4c0c-9e06-38fb1e617a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:13.790236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c3872-87c2-4c0c-9e06-38fb1e617a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:13.790590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c3872-87c2-4c0c-9e06-38fb1e617a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:13.791387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c3872-87c2-4c0c-9e06-38fb1e617a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:13.793243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c3872-87c2-4c0c-9e06-38fb1e617a36 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:13.808701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1088/2173] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:13.809909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fb767-b5bc-4a03-a71c-be0a4f35f169 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:13.830250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fb767-b5bc-4a03-a71c-be0a4f35f169 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:13.836478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:13.837119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:13.837457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:13.837737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:13.838868 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:13.840232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:13.853089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1086/2174] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:41:13.859030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c3872-87c2-4c0c-9e06-38fb1e617a36 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:13.872082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c3872-87c2-4c0c-9e06-38fb1e617a36 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:13.877541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4fe01-89ee-45cb-bc7d-b7c46052d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:13.887831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4fe01-89ee-45cb-bc7d-b7c46052d4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:13.887831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4fe01-89ee-45cb-bc7d-b7c46052d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:13.887831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4fe01-89ee-45cb-bc7d-b7c46052d4e6 admin admin] PATH_INFO: `/v3/projects/19540ab07f6d4f96ad6a8a92fdee8bfd/users/b2beb83cd682459d8e8c1548696ab046/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:13.906903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4fe01-89ee-45cb-bc7d-b7c46052d4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19540ab07f6d4f96ad6a8a92fdee8bfd, user_id=b2beb83cd682459d8e8c1548696ab046, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:13.910763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4fe01-89ee-45cb-bc7d-b7c46052d4e6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:13.979365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:13.984267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:14.001072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd702b-f669-45b6-b1f1-bffa5c702b22 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:14.006942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:14.007663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:14.007942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:14.008282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] PATH_INFO: `/v3/users/fbdc39a09202467bb4f5dec676fb766f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:14.009932 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdc39a09202467bb4f5dec676fb766f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:14.012029 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:14.030114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1089/2175] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:13 2022] PUT /identity/v3/projects/19540ab07f6d4f96ad6a8a92fdee8bfd/users/b2beb83cd682459d8e8c1548696ab046/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:14.041029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72fe5-01fb-42f6-b393-157b2db226ef None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:14.041644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72fe5-01fb-42f6-b393-157b2db226ef None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:14.041644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f72fe5-01fb-42f6-b393-157b2db226ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:14.074331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-08f72fe5-01fb-42f6-b393-157b2db226ef None None] MFA Rules not processed for user `b2beb83cd682459d8e8c1548696ab046`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:14.075713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-08f72fe5-01fb-42f6-b393-157b2db226ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:14.203098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1090/2176] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:14.221450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f72fe5-01fb-42f6-b393-157b2db226ef None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:14.224235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-08f72fe5-01fb-42f6-b393-157b2db226ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:14.273165 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdc39a09202467bb4f5dec676fb766f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.295646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdc39a09202467bb4f5dec676fb766f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.333700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f72fe5-01fb-42f6-b393-157b2db226ef None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:14.339055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:14.343012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:14.343012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:14.343012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:14.351563 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:14.357553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:14.371748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1091/2177] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:41:14.372737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:14.375150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:14.391322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdc39a09202467bb4f5dec676fb766f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.391968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdc39a09202467bb4f5dec676fb766f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.413275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f7404e42-efd7-414d-9b51-9027e2ce05e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdc39a09202467bb4f5dec676fb766f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.428830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1087/2178] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:13 2022] DELETE /identity/v3/users/fbdc39a09202467bb4f5dec676fb766f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:14.430733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4ff4-d7ab-4bcd-9ac1-644dbc200b4a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:14.433558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4ff4-d7ab-4bcd-9ac1-644dbc200b4a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:14.434272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b4ff4-d7ab-4bcd-9ac1-644dbc200b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:14.470291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-745b4ff4-d7ab-4bcd-9ac1-644dbc200b4a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:14.473382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-745b4ff4-d7ab-4bcd-9ac1-644dbc200b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:14.560116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1088/2179] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:14.560531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234d345-3c5b-4f3c-ac2a-38dd1dabda9e service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:14.573452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:14.577407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:14.577723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:14.578027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] PATH_INFO: `/v3/projects/1223023afb6847689cc9a33908086c05` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:14.579311 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1223023afb6847689cc9a33908086c05)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:14.582147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:14.621941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4ff4-d7ab-4bcd-9ac1-644dbc200b4a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:14.623492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-745b4ff4-d7ab-4bcd-9ac1-644dbc200b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:14.723613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b4ff4-d7ab-4bcd-9ac1-644dbc200b4a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:14.734590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:14.734590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:14.734590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:14.734590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:14.743375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1223023afb6847689cc9a33908086c05', 'request_id': 'req-223523cf-9ef9-468f-bcc1-79d40b0c31cc'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.762980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:14.764773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:14.776457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1089/2180] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:41:14.859703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1223023afb6847689cc9a33908086c05', 'request_id': 'req-223523cf-9ef9-468f-bcc1-79d40b0c31cc'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.873348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1223023afb6847689cc9a33908086c05', 'request_id': 'req-223523cf-9ef9-468f-bcc1-79d40b0c31cc'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.887718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] The token cache is being invalidate because project 1223023afb6847689cc9a33908086c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:14.888296 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.889271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:14.897051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1092/2181] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:14 2022] DELETE /identity/v3/projects/1223023afb6847689cc9a33908086c05 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:14.900950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:14.902662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:14.920745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639afcb-250d-4fb4-9276-2e93fa36d20b service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:15.028304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:15.029086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:15.029367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:15.029656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] PATH_INFO: `/v3/users/37e6327fd4694774801f80203f2fdd11` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:15.030967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e6327fd4694774801f80203f2fdd11)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:15.033116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:15.255325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:15.380510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e6327fd4694774801f80203f2fdd11'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:15.400633 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e6327fd4694774801f80203f2fdd11'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:15.528146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e6327fd4694774801f80203f2fdd11'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:15.529080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e6327fd4694774801f80203f2fdd11'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:15.538551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e6327fd4694774801f80203f2fdd11'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:15.540102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:15.541552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:15.545747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1090/2182] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:14 2022] DELETE /identity/v3/users/37e6327fd4694774801f80203f2fdd11 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:15.586642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223523cf-9ef9-468f-bcc1-79d40b0c31cc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:15.707274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:15.710014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:15.710014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:15.710014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] PATH_INFO: `/v3/projects/da109146518c41cc8f06e5ab6f2ae2a8` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:15.710014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da109146518c41cc8f06e5ab6f2ae2a8)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:15.712551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:15.896909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da109146518c41cc8f06e5ab6f2ae2a8', 'request_id': 'req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.058541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da109146518c41cc8f06e5ab6f2ae2a8', 'request_id': 'req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.066128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da109146518c41cc8f06e5ab6f2ae2a8', 'request_id': 'req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.078844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] The token cache is being invalidate because project da109146518c41cc8f06e5ab6f2ae2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:16.079134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.080173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.082347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1093/2183] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:15 2022] DELETE /identity/v3/projects/da109146518c41cc8f06e5ab6f2ae2a8 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:16.086730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:16.096243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:16.103478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305a99e-6e44-4cc5-b425-634b1d01557e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:16.189098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:16.190698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:16.190998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:16.191401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] PATH_INFO: `/v3/users/d082fa4b29964a3f84a7306d2ac5983b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:16.199952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d082fa4b29964a3f84a7306d2ac5983b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:16.203044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:16.279879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:16.282246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:16.312024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62958dd-be80-4da0-8ecb-6ea49bcdeca2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:16.327838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:16.330443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:16.330890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:16.331692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] PATH_INFO: `/v3/projects/84975b0d255b42459e36f4dd199221cc` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:16.333672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84975b0d255b42459e36f4dd199221cc)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:16.335672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:16.362937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:16.415786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd082fa4b29964a3f84a7306d2ac5983b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.447404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd082fa4b29964a3f84a7306d2ac5983b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.479983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84975b0d255b42459e36f4dd199221cc', 'request_id': 'req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.555370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd082fa4b29964a3f84a7306d2ac5983b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.556750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd082fa4b29964a3f84a7306d2ac5983b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.568490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-73da86fb-2d69-4e11-8a8b-14ac2d9853d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd082fa4b29964a3f84a7306d2ac5983b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.582522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1091/2184] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:16 2022] DELETE /identity/v3/users/d082fa4b29964a3f84a7306d2ac5983b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:16.635079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d253e0-1254-40a5-86db-45ca39ec0e09 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:16.635366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d253e0-1254-40a5-86db-45ca39ec0e09 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:16.635643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d253e0-1254-40a5-86db-45ca39ec0e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:16.671838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-58d253e0-1254-40a5-86db-45ca39ec0e09 None None] MFA Rules not processed for user `b2beb83cd682459d8e8c1548696ab046`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:16.673081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-58d253e0-1254-40a5-86db-45ca39ec0e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:16.676869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84975b0d255b42459e36f4dd199221cc', 'request_id': 'req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.687725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84975b0d255b42459e36f4dd199221cc', 'request_id': 'req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.718694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] The token cache is being invalidate because project 84975b0d255b42459e36f4dd199221cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:16.719010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.720519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0b214bbd-f69c-451d-a0e5-09ccd9b4eed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:16.723852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1094/2185] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:16 2022] DELETE /identity/v3/projects/84975b0d255b42459e36f4dd199221cc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:16.731995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4db7-1468-4240-98e6-5d66ca6cc6de None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:16.732358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4db7-1468-4240-98e6-5d66ca6cc6de None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:16.732635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4db7-1468-4240-98e6-5d66ca6cc6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:16.823022 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1092/2186] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:41:16.829014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ab1f4db7-1468-4240-98e6-5d66ca6cc6de None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:16.830473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ab1f4db7-1468-4240-98e6-5d66ca6cc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:16.986892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1095/2187] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:17.002309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091239-aa87-445e-bb2b-85a22f658446 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.002309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091239-aa87-445e-bb2b-85a22f658446 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.002309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091239-aa87-445e-bb2b-85a22f658446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.036327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f5091239-aa87-445e-bb2b-85a22f658446 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:17.038417 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f5091239-aa87-445e-bb2b-85a22f658446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:17.051026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1093/2188] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:17.053391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4db7-1468-4240-98e6-5d66ca6cc6de None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:17.075939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4db7-1468-4240-98e6-5d66ca6cc6de None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:17.081925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:17.082826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.083271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.083692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.084519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:17.085026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:17.087158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:17.104119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1096/2189] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:17.108928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5091239-aa87-445e-bb2b-85a22f658446 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:17.124428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5091239-aa87-445e-bb2b-85a22f658446 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:17.137677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ad895-b103-4181-ac03-bf6c2f4d70e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:17.138589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ad895-b103-4181-ac03-bf6c2f4d70e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.139156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ad895-b103-4181-ac03-bf6c2f4d70e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.139607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ad895-b103-4181-ac03-bf6c2f4d70e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.140459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ad895-b103-4181-ac03-bf6c2f4d70e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:17.144523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ad895-b103-4181-ac03-bf6c2f4d70e5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:17.307963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1094/2190] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:17 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:17.308973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:17.325457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34b1c5-b2e1-47d8-a5af-8dd8e6559fca admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:17.408471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295590c5-7038-4324-83b0-adcaa6a6e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:17.410265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295590c5-7038-4324-83b0-adcaa6a6e547 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.410265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295590c5-7038-4324-83b0-adcaa6a6e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.410265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295590c5-7038-4324-83b0-adcaa6a6e547 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.411361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295590c5-7038-4324-83b0-adcaa6a6e547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:17.413720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295590c5-7038-4324-83b0-adcaa6a6e547 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:17.557800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1097/2191] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:17 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:41:17.561615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ad895-b103-4181-ac03-bf6c2f4d70e5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:17.573569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ad895-b103-4181-ac03-bf6c2f4d70e5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:17.594385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417143f-0d84-43c2-9f2e-a4240442d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:17.595339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417143f-0d84-43c2-9f2e-a4240442d2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.595339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417143f-0d84-43c2-9f2e-a4240442d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.595601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417143f-0d84-43c2-9f2e-a4240442d2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.596263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417143f-0d84-43c2-9f2e-a4240442d2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:17.598679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417143f-0d84-43c2-9f2e-a4240442d2f2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:17.613867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1095/2192] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:17.614943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295590c5-7038-4324-83b0-adcaa6a6e547 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:17.641171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295590c5-7038-4324-83b0-adcaa6a6e547 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:17.647165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:17.648211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.648980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.650044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.651059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:17.653199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:17.666418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1098/2193] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:41:17.671402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417143f-0d84-43c2-9f2e-a4240442d2f2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:17.683877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417143f-0d84-43c2-9f2e-a4240442d2f2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:17.688913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1396a-bdee-4155-a6b0-055350c6c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:17.689585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1396a-bdee-4155-a6b0-055350c6c758 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.689865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1396a-bdee-4155-a6b0-055350c6c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.690870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1396a-bdee-4155-a6b0-055350c6c758 admin admin] PATH_INFO: `/v3/projects/132c7679cb964fd78c933506c791dd4a/users/e21742c06a4247078e56958e53747c6a/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.695619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:17.711581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1396a-bdee-4155-a6b0-055350c6c758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132c7679cb964fd78c933506c791dd4a, user_id=e21742c06a4247078e56958e53747c6a, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:17.714853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1396a-bdee-4155-a6b0-055350c6c758 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:17.736978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:17.740081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:17.794402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a1367-9796-4339-8c8d-10eeb44a9f4c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:17.801360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:17.802359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.802649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.802924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] PATH_INFO: `/v3/projects/eeba2f74cad842c0980d80babb2e1e5b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.804928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeba2f74cad842c0980d80babb2e1e5b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:17.807046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:17.826847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1096/2194] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:17 2022] PUT /identity/v3/projects/132c7679cb964fd78c933506c791dd4a/users/e21742c06a4247078e56958e53747c6a/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:17.837826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d3aee-5a15-496e-8474-55a4131d4aa9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:17.838137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d3aee-5a15-496e-8474-55a4131d4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:17.838409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d3aee-5a15-496e-8474-55a4131d4aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:17.861725 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ab5d3aee-5a15-496e-8474-55a4131d4aa9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:17.863127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ab5d3aee-5a15-496e-8474-55a4131d4aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:17.985573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeba2f74cad842c0980d80babb2e1e5b', 'request_id': 'req-7c22a823-5b1d-4bb4-8606-1e264f3695a3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.007355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1097/2195] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:18.024613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d3aee-5a15-496e-8474-55a4131d4aa9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:18.026297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ab5d3aee-5a15-496e-8474-55a4131d4aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:18.117224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d3aee-5a15-496e-8474-55a4131d4aa9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:18.127671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeba2f74cad842c0980d80babb2e1e5b', 'request_id': 'req-7c22a823-5b1d-4bb4-8606-1e264f3695a3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.142617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeba2f74cad842c0980d80babb2e1e5b', 'request_id': 'req-7c22a823-5b1d-4bb4-8606-1e264f3695a3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.154154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] The token cache is being invalidate because project eeba2f74cad842c0980d80babb2e1e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:18.154503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.155208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c22a823-5b1d-4bb4-8606-1e264f3695a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.157144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1099/2196] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:17 2022] DELETE /identity/v3/projects/eeba2f74cad842c0980d80babb2e1e5b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:18.164943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b26f4-cf2c-4c00-9eb1-9c6f6bf28b31 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.165470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b26f4-cf2c-4c00-9eb1-9c6f6bf28b31 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.170319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b26f4-cf2c-4c00-9eb1-9c6f6bf28b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.195073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446ca15-04c5-45b4-924a-0a3965f6cc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:18.196040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446ca15-04c5-45b4-924a-0a3965f6cc45 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.196386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446ca15-04c5-45b4-924a-0a3965f6cc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.196672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446ca15-04c5-45b4-924a-0a3965f6cc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.198569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0446ca15-04c5-45b4-924a-0a3965f6cc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:18.202772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ad7b26f4-cf2c-4c00-9eb1-9c6f6bf28b31 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:18.204056 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ad7b26f4-cf2c-4c00-9eb1-9c6f6bf28b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:18.356322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446ca15-04c5-45b4-924a-0a3965f6cc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:18.356811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1100/2197] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:18.357097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446ca15-04c5-45b4-924a-0a3965f6cc45 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:18.357377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739deda2-4cae-4278-af09-b8ea5b858157 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.357377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739deda2-4cae-4278-af09-b8ea5b858157 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.357377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739deda2-4cae-4278-af09-b8ea5b858157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.357703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1098/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:18.357919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-739deda2-4cae-4278-af09-b8ea5b858157 None None] MFA Rules not processed for user `2b0375d6cd584faeab759ff9f5cd98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:18.357919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-739deda2-4cae-4278-af09-b8ea5b858157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:18.363537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065da0f-af0c-42ea-8516-8162138e5138 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.363972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065da0f-af0c-42ea-8516-8162138e5138 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.364313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065da0f-af0c-42ea-8516-8162138e5138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.392381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0065da0f-af0c-42ea-8516-8162138e5138 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:18.394306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0065da0f-af0c-42ea-8516-8162138e5138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:18.408802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1099/2199] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:18.411011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065da0f-af0c-42ea-8516-8162138e5138 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:18.421336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065da0f-af0c-42ea-8516-8162138e5138 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:18.429537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:18.430236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.430573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.432843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.433544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:18.434091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:18.436367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:18.451385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1100/2200] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:18.452251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:18.453994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:18.463906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1101/2201] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:18.464810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739deda2-4cae-4278-af09-b8ea5b858157 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:18.475551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25a1d-100e-4d6a-84c6-29f6a47dabe9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:18.479306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739deda2-4cae-4278-af09-b8ea5b858157 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:18.481297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:18.482970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.483444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.484005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] PATH_INFO: `/v3/users/450d9adcf8dc4a4cb084b8c05c25b464` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.484596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a0604-394f-40c2-9531-cf88b1b5aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:18.485218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a0604-394f-40c2-9531-cf88b1b5aee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.485496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a0604-394f-40c2-9531-cf88b1b5aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.485793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a0604-394f-40c2-9531-cf88b1b5aee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.486200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450d9adcf8dc4a4cb084b8c05c25b464)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:18.486496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a0604-394f-40c2-9531-cf88b1b5aee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:18.489300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:18.489745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a0604-394f-40c2-9531-cf88b1b5aee9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:18.660516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1102/2202] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:18 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:18.664421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a0604-394f-40c2-9531-cf88b1b5aee9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:18.734206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a0604-394f-40c2-9531-cf88b1b5aee9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:18.739799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9660c9-fa80-4236-9f5b-a2dfacebb57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:18.740395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9660c9-fa80-4236-9f5b-a2dfacebb57f admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.740668 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9660c9-fa80-4236-9f5b-a2dfacebb57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.741005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9660c9-fa80-4236-9f5b-a2dfacebb57f admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.741655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9660c9-fa80-4236-9f5b-a2dfacebb57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:18.743850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9660c9-fa80-4236-9f5b-a2dfacebb57f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:18.858760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450d9adcf8dc4a4cb084b8c05c25b464'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.875137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450d9adcf8dc4a4cb084b8c05c25b464'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.879381 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1103/2203] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:18 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:41:18.883118 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9660c9-fa80-4236-9f5b-a2dfacebb57f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:18.895352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9660c9-fa80-4236-9f5b-a2dfacebb57f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:18.902080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4fe40-1151-4c19-b2fe-12339cb2a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:18.912218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4fe40-1151-4c19-b2fe-12339cb2a82d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.912218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4fe40-1151-4c19-b2fe-12339cb2a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.912218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4fe40-1151-4c19-b2fe-12339cb2a82d admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.912218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4fe40-1151-4c19-b2fe-12339cb2a82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:18.912218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4fe40-1151-4c19-b2fe-12339cb2a82d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:18.918141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1104/2204] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:41:18.920968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4fe40-1151-4c19-b2fe-12339cb2a82d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:18.931902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4fe40-1151-4c19-b2fe-12339cb2a82d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:18.936704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301be2d-42d5-429a-9508-d7279e446ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:18.937377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301be2d-42d5-429a-9508-d7279e446ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:18.937658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301be2d-42d5-429a-9508-d7279e446ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:18.937929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301be2d-42d5-429a-9508-d7279e446ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:18.938624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301be2d-42d5-429a-9508-d7279e446ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:18.940694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301be2d-42d5-429a-9508-d7279e446ef1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:18.954513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1105/2205] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:18.958298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301be2d-42d5-429a-9508-d7279e446ef1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:18.963891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450d9adcf8dc4a4cb084b8c05c25b464'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.964530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450d9adcf8dc4a4cb084b8c05c25b464'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.977852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-485693bd-d36a-44e4-b0c8-540da26d2553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450d9adcf8dc4a4cb084b8c05c25b464'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:18.982565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301be2d-42d5-429a-9508-d7279e446ef1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:19.005154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1101/2206] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:18 2022] DELETE /identity/v3/users/450d9adcf8dc4a4cb084b8c05c25b464 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:19.011259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ee4ed-afc5-4469-b3b1-8a6a32e39abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:19.011957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921c81-0037-476b-9619-681694f0d2ea None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:19.012246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921c81-0037-476b-9619-681694f0d2ea None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:19.012520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41921c81-0037-476b-9619-681694f0d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:19.016139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee4ed-afc5-4469-b3b1-8a6a32e39abd admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:19.016423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee4ed-afc5-4469-b3b1-8a6a32e39abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:19.017060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee4ed-afc5-4469-b3b1-8a6a32e39abd admin admin] PATH_INFO: `/v3/projects/9aac8830b6664ed0ade1f0d630078a35/users/7052619ba4b84560bacc909ab10dc738/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:19.039763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ee4ed-afc5-4469-b3b1-8a6a32e39abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aac8830b6664ed0ade1f0d630078a35, user_id=7052619ba4b84560bacc909ab10dc738, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:19.042965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ee4ed-afc5-4469-b3b1-8a6a32e39abd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:19.043384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-41921c81-0037-476b-9619-681694f0d2ea None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:19.045050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-41921c81-0037-476b-9619-681694f0d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:19.121808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1102/2207] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:19.132511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41921c81-0037-476b-9619-681694f0d2ea None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:19.134230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-41921c81-0037-476b-9619-681694f0d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:19.149027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1106/2208] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:18 2022] PUT /identity/v3/projects/9aac8830b6664ed0ade1f0d630078a35/users/7052619ba4b84560bacc909ab10dc738/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:19.166727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef93a9-c4e7-476b-885d-cd6bcc283ee9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:19.167099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef93a9-c4e7-476b-885d-cd6bcc283ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:19.167444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef93a9-c4e7-476b-885d-cd6bcc283ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:19.197323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5cef93a9-c4e7-476b-885d-cd6bcc283ee9 None None] MFA Rules not processed for user `7052619ba4b84560bacc909ab10dc738`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:19.197559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41921c81-0037-476b-9619-681694f0d2ea None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:19.198592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5cef93a9-c4e7-476b-885d-cd6bcc283ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:19.260787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390920a7-e477-42f4-8dbd-43f05a753654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:19.261423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390920a7-e477-42f4-8dbd-43f05a753654 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:19.261739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390920a7-e477-42f4-8dbd-43f05a753654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:19.262018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390920a7-e477-42f4-8dbd-43f05a753654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:19.266726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:19.275693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1107/2209] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:41:19.280339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef93a9-c4e7-476b-885d-cd6bcc283ee9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:19.282757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5cef93a9-c4e7-476b-885d-cd6bcc283ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:19.361185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390920a7-e477-42f4-8dbd-43f05a753654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:19.364217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390920a7-e477-42f4-8dbd-43f05a753654 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:19.406403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1103/2210] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:41:19.439781 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef93a9-c4e7-476b-885d-cd6bcc283ee9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:19.446284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f28dc-5624-48a6-be5f-9ce30bd67445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:19.447086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f28dc-5624-48a6-be5f-9ce30bd67445 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:19.447532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f28dc-5624-48a6-be5f-9ce30bd67445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:19.447976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f28dc-5624-48a6-be5f-9ce30bd67445 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:19.448785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f28dc-5624-48a6-be5f-9ce30bd67445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:19.451645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f28dc-5624-48a6-be5f-9ce30bd67445 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:19.593236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1108/2211] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:19 2022] POST /identity/v3/projects => generated 381 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:41:19.599364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390920a7-e477-42f4-8dbd-43f05a753654 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:19.609884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390920a7-e477-42f4-8dbd-43f05a753654 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:19.683968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b512b-3fd6-4d49-84c0-1d6770bbfc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:19.684756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b512b-3fd6-4d49-84c0-1d6770bbfc99 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:19.685068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b512b-3fd6-4d49-84c0-1d6770bbfc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:19.685362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b512b-3fd6-4d49-84c0-1d6770bbfc99 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:19.686070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b512b-3fd6-4d49-84c0-1d6770bbfc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:19.688141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b512b-3fd6-4d49-84c0-1d6770bbfc99 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:19.871497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1104/2212] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:19 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:19.876526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f28dc-5624-48a6-be5f-9ce30bd67445 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:19.886636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f28dc-5624-48a6-be5f-9ce30bd67445 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:19.892547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf01205-42dc-43bd-8587-2d8af42b3c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:19.893159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf01205-42dc-43bd-8587-2d8af42b3c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:19.894055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf01205-42dc-43bd-8587-2d8af42b3c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:19.894778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf01205-42dc-43bd-8587-2d8af42b3c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:19.895000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf01205-42dc-43bd-8587-2d8af42b3c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:19.897006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf01205-42dc-43bd-8587-2d8af42b3c12 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:19.907433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1109/2213] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:19.911853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b512b-3fd6-4d49-84c0-1d6770bbfc99 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:19.922473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b512b-3fd6-4d49-84c0-1d6770bbfc99 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:19.927958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:19.928623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:19.928905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:19.929497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] PATH_INFO: `/v3/projects/04d103f3c2ae4137aaebb23ad13deccc/users/f70d5a209ee74696b3db8de46c7a8842/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:19.960183 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d103f3c2ae4137aaebb23ad13deccc, user_id=f70d5a209ee74696b3db8de46c7a8842, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:19.963667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:20.167594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1105/2214] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:19 2022] PUT /identity/v3/projects/04d103f3c2ae4137aaebb23ad13deccc/users/f70d5a209ee74696b3db8de46c7a8842/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:20.168715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf01205-42dc-43bd-8587-2d8af42b3c12 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:20.184193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf01205-42dc-43bd-8587-2d8af42b3c12 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:20.210085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:20.212389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:20.267251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dccc1-142b-4072-a463-557fc2c4fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:20.267863 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dccc1-142b-4072-a463-557fc2c4fade admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.268141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dccc1-142b-4072-a463-557fc2c4fade admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.268463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991dccc1-142b-4072-a463-557fc2c4fade admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.269207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dccc1-142b-4072-a463-557fc2c4fade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:20.270818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991dccc1-142b-4072-a463-557fc2c4fade admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:20.281458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1110/2215] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:20.285913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dccc1-142b-4072-a463-557fc2c4fade admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:20.295972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991dccc1-142b-4072-a463-557fc2c4fade admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:20.302562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6bba3-9af2-4322-b40c-474ea7b12912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:20.303266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6bba3-9af2-4322-b40c-474ea7b12912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.303462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f3ff9-91db-434d-86b4-4d089459ffe1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:20.303674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6bba3-9af2-4322-b40c-474ea7b12912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.303961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6bba3-9af2-4322-b40c-474ea7b12912 admin admin] PATH_INFO: `/v3/projects/04d103f3c2ae4137aaebb23ad13deccc/users/f70d5a209ee74696b3db8de46c7a8842/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.305904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6bba3-9af2-4322-b40c-474ea7b12912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d103f3c2ae4137aaebb23ad13deccc, user_id=f70d5a209ee74696b3db8de46c7a8842, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:20.308697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6bba3-9af2-4322-b40c-474ea7b12912 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:20.309172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:20.309841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.310154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.310425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] PATH_INFO: `/v3/projects/4752d2d4321943f192a96c67753d3f71` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.311564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4752d2d4321943f192a96c67753d3f71)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:20.313440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:20.320250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1111/2216] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:20 2022] PUT /identity/v3/projects/04d103f3c2ae4137aaebb23ad13deccc/users/f70d5a209ee74696b3db8de46c7a8842/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:20.330585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabeca3-b2b5-4770-9682-cdfe9673a436 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.330926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabeca3-b2b5-4770-9682-cdfe9673a436 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.331270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabeca3-b2b5-4770-9682-cdfe9673a436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.374492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5aabeca3-b2b5-4770-9682-cdfe9673a436 None None] MFA Rules not processed for user `f70d5a209ee74696b3db8de46c7a8842`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:20.375726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5aabeca3-b2b5-4770-9682-cdfe9673a436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:20.457763 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4752d2d4321943f192a96c67753d3f71', 'request_id': 'req-2651182a-5cdb-4707-b43e-4eb638851142'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:20.472488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1112/2217] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:41:20.473822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21bd42-53e1-4fd5-b24b-99f23714d0fe None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.474161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21bd42-53e1-4fd5-b24b-99f23714d0fe None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.474875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21bd42-53e1-4fd5-b24b-99f23714d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.510353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5b21bd42-53e1-4fd5-b24b-99f23714d0fe None None] MFA Rules not processed for user `e21742c06a4247078e56958e53747c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:20.514358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5b21bd42-53e1-4fd5-b24b-99f23714d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:20.561864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4752d2d4321943f192a96c67753d3f71', 'request_id': 'req-2651182a-5cdb-4707-b43e-4eb638851142'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:20.568935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4752d2d4321943f192a96c67753d3f71', 'request_id': 'req-2651182a-5cdb-4707-b43e-4eb638851142'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:20.599316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1113/2218] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:20.600199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21bd42-53e1-4fd5-b24b-99f23714d0fe None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:20.601664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5b21bd42-53e1-4fd5-b24b-99f23714d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:20.603225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] The token cache is being invalidate because project 4752d2d4321943f192a96c67753d3f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:20.603533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:20.609358 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:20.614499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1106/2219] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:20 2022] DELETE /identity/v3/projects/4752d2d4321943f192a96c67753d3f71 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:20.614499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:20.614774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:20.673849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21bd42-53e1-4fd5-b24b-99f23714d0fe None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:20.673849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:20.673849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.674157 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.674245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.676645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:20.691042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651182a-5cdb-4707-b43e-4eb638851142 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:20.702665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11401438-fb9c-4fc4-99e3-6a2afadc2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:20.703296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401438-fb9c-4fc4-99e3-6a2afadc2bca admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.703702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401438-fb9c-4fc4-99e3-6a2afadc2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.703982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401438-fb9c-4fc4-99e3-6a2afadc2bca admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.705081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11401438-fb9c-4fc4-99e3-6a2afadc2bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:20.708391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11401438-fb9c-4fc4-99e3-6a2afadc2bca admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:20.745408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:20.753660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:20.758669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1114/2220] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:20.759670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:20.761268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:20.776418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8c047-202f-43d5-9664-6e70e82533e7 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:20.781752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:20.782418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.782837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.782965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] PATH_INFO: `/v3/users/3cae7c26a6a54de38cecf676ec6aa711` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.784314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cae7c26a6a54de38cecf676ec6aa711)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:20.786228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:20.831162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1107/2221] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:20 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:20.834697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11401438-fb9c-4fc4-99e3-6a2afadc2bca admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:20.916398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11401438-fb9c-4fc4-99e3-6a2afadc2bca admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:20.921673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:20.922319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:20.922660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:20.922866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:20.923483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:20.926615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:21.027546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cae7c26a6a54de38cecf676ec6aa711'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.028505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cae7c26a6a54de38cecf676ec6aa711'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.039874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cae7c26a6a54de38cecf676ec6aa711'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.063033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cae7c26a6a54de38cecf676ec6aa711'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.063816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cae7c26a6a54de38cecf676ec6aa711'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.085717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1108/2222] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:20 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:41:21.087050 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:21.089565 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:21.102649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f6c26-c4f2-4f6e-9cb1-0fac6dd70e03 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:21.110143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed7e50-6e25-41a5-bfdc-2aec0e60d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:21.110941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed7e50-6e25-41a5-bfdc-2aec0e60d839 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:21.111409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed7e50-6e25-41a5-bfdc-2aec0e60d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:21.111752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed7e50-6e25-41a5-bfdc-2aec0e60d839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:21.113106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed7e50-6e25-41a5-bfdc-2aec0e60d839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:21.114968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed7e50-6e25-41a5-bfdc-2aec0e60d839 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:21.126619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1109/2223] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:21.130896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed7e50-6e25-41a5-bfdc-2aec0e60d839 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:21.153055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed7e50-6e25-41a5-bfdc-2aec0e60d839 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:21.153055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:21.153055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:21.153055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:21.153383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] PATH_INFO: `/v3/projects/6b3888cb7e5741afa653fb512be2130e/users/b2d1e0f4ad704ad3a1a7221860a2cc91/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:21.170152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3888cb7e5741afa653fb512be2130e, user_id=b2d1e0f4ad704ad3a1a7221860a2cc91, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:21.173238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:21.248762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1115/2224] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:20 2022] DELETE /identity/v3/users/3cae7c26a6a54de38cecf676ec6aa711 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:21.256720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1110/2225] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:21 2022] PUT /identity/v3/projects/6b3888cb7e5741afa653fb512be2130e/users/b2d1e0f4ad704ad3a1a7221860a2cc91/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:21.260788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:21.288226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:21.336074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075cbf-3be7-4fe2-b222-d275b22ec28c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:21.405287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:21.407379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:21.417793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f457f-e44a-4366-b14b-d696d4686491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:21.418443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f457f-e44a-4366-b14b-d696d4686491 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:21.418719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f457f-e44a-4366-b14b-d696d4686491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:21.418990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f457f-e44a-4366-b14b-d696d4686491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:21.419669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f457f-e44a-4366-b14b-d696d4686491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:21.421360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f457f-e44a-4366-b14b-d696d4686491 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:21.438081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1116/2226] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:21.438081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f457f-e44a-4366-b14b-d696d4686491 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:21.459028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f457f-e44a-4366-b14b-d696d4686491 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:21.465198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:21.466253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:21.467263 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:21.467263 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] PATH_INFO: `/v3/projects/6b3888cb7e5741afa653fb512be2130e/users/b2d1e0f4ad704ad3a1a7221860a2cc91/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:21.469851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3888cb7e5741afa653fb512be2130e, user_id=b2d1e0f4ad704ad3a1a7221860a2cc91, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:21.474627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:21.484443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2910f34-1846-4554-8a9d-dfe3796e3f20 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:21.491528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:21.495060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:21.495060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:21.495060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] PATH_INFO: `/v3/users/7052619ba4b84560bacc909ab10dc738` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:21.495060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7052619ba4b84560bacc909ab10dc738)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:21.495904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:21.506784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1117/2227] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:21 2022] PUT /identity/v3/projects/6b3888cb7e5741afa653fb512be2130e/users/b2d1e0f4ad704ad3a1a7221860a2cc91/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:21.770006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7052619ba4b84560bacc909ab10dc738'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.785607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7052619ba4b84560bacc909ab10dc738'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.810461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:21.812301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:21.899847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7052619ba4b84560bacc909ab10dc738'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.905122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7052619ba4b84560bacc909ab10dc738'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.906041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f73a0-063b-4695-b9b4-4c8d539c4fbe admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:21.910684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b44f7486-61dc-4da4-b8d5-209dce3e6f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7052619ba4b84560bacc909ab10dc738'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:21.912274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:21.912988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:21.913339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:21.913685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] PATH_INFO: `/v3/projects/8c6c355c56b0407c97f95f282dfd8eb7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:21.914929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6c355c56b0407c97f95f282dfd8eb7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:21.917294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:21.917429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1111/2228] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:21 2022] DELETE /identity/v3/users/7052619ba4b84560bacc909ab10dc738 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:21.922577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca647c-796f-41c0-93d3-496818f2a2db None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:21.922868 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca647c-796f-41c0-93d3-496818f2a2db None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:21.923145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca647c-796f-41c0-93d3-496818f2a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:21.949820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5cca647c-796f-41c0-93d3-496818f2a2db None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:21.951422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5cca647c-796f-41c0-93d3-496818f2a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:21.990687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:22.014941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1112/2229] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:22.026013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca647c-796f-41c0-93d3-496818f2a2db None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:22.027364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5cca647c-796f-41c0-93d3-496818f2a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:22.071153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6c355c56b0407c97f95f282dfd8eb7', 'request_id': 'req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.113823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca647c-796f-41c0-93d3-496818f2a2db None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:22.179471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:22.180247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:22.180413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:22.180688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:22.209740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6c355c56b0407c97f95f282dfd8eb7', 'request_id': 'req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.218194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6c355c56b0407c97f95f282dfd8eb7', 'request_id': 'req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.231068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] The token cache is being invalidate because project 8c6c355c56b0407c97f95f282dfd8eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:22.231201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.231848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.236412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1118/2230] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:21 2022] DELETE /identity/v3/projects/8c6c355c56b0407c97f95f282dfd8eb7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:22.239107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:22.242185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:22.291116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:22.291116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:22.302199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1113/2231] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:22.335403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed20e6-e214-4d20-baef-dbd5d8c8fc2b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:22.340561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:22.341338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:22.342330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:22.342330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] PATH_INFO: `/v3/users/ddf04699bb384fdf837e295aa2bda35e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:22.343291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf04699bb384fdf837e295aa2bda35e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:22.345315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:22.596293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf04699bb384fdf837e295aa2bda35e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.598775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf04699bb384fdf837e295aa2bda35e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.626785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf04699bb384fdf837e295aa2bda35e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.641839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf04699bb384fdf837e295aa2bda35e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.642338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf04699bb384fdf837e295aa2bda35e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:22.725602 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1119/2232] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:22 2022] DELETE /identity/v3/users/ddf04699bb384fdf837e295aa2bda35e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:23.085194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:23.086728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:23.099804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d57e0d-3a44-4321-a2e4-6d48472c3ece service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:23.174007 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:23.175329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:23.175664 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:23.176085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] PATH_INFO: `/v3/projects/9aac8830b6664ed0ade1f0d630078a35` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:23.177328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aac8830b6664ed0ade1f0d630078a35)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:23.179952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:23.333290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aac8830b6664ed0ade1f0d630078a35', 'request_id': 'req-c01c19e5-6989-408e-acae-ad851bfdeadf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.407810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aac8830b6664ed0ade1f0d630078a35', 'request_id': 'req-c01c19e5-6989-408e-acae-ad851bfdeadf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.414911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aac8830b6664ed0ade1f0d630078a35', 'request_id': 'req-c01c19e5-6989-408e-acae-ad851bfdeadf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.432891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] The token cache is being invalidate because project 9aac8830b6664ed0ade1f0d630078a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:23.433188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.434814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.436411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1114/2233] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:23 2022] DELETE /identity/v3/projects/9aac8830b6664ed0ade1f0d630078a35 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:23.441816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:23.445564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:23.461080 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ffdf8-53e1-42c9-85ef-91337cdf137f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:23.577707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:23.579766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:23.579766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:23.579766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] PATH_INFO: `/v3/users/f70d5a209ee74696b3db8de46c7a8842` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:23.587889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70d5a209ee74696b3db8de46c7a8842)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:23.587889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:23.642382 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:23.669410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:23.672517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:23.697742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c19e5-6989-408e-acae-ad851bfdeadf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:23.712506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:23.721072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:23.723989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:23.724583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] PATH_INFO: `/v3/projects/8617ae3161254a73a96eb472046e6903` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:23.726052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8617ae3161254a73a96eb472046e6903)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:23.728097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:23.930518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8617ae3161254a73a96eb472046e6903', 'request_id': 'req-8ec9f89d-f996-49e2-a3a3-fc484067ac48'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.933492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70d5a209ee74696b3db8de46c7a8842'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.934762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70d5a209ee74696b3db8de46c7a8842'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.945740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70d5a209ee74696b3db8de46c7a8842'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.962566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70d5a209ee74696b3db8de46c7a8842'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:23.963308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-7c415550-f6d3-494c-861e-d9f50c43e891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70d5a209ee74696b3db8de46c7a8842'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:24.071091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8617ae3161254a73a96eb472046e6903', 'request_id': 'req-8ec9f89d-f996-49e2-a3a3-fc484067ac48'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:24.079169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8617ae3161254a73a96eb472046e6903', 'request_id': 'req-8ec9f89d-f996-49e2-a3a3-fc484067ac48'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:24.093888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] The token cache is being invalidate because project 8617ae3161254a73a96eb472046e6903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:24.094481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:24.095376 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8ec9f89d-f996-49e2-a3a3-fc484067ac48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:24.098200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1115/2234] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:23 2022] DELETE /identity/v3/projects/8617ae3161254a73a96eb472046e6903 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:24.099429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36880-5547-4487-8348-7066eb74164d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.099710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36880-5547-4487-8348-7066eb74164d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.099983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef36880-5547-4487-8348-7066eb74164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.143053 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-aef36880-5547-4487-8348-7066eb74164d None None] MFA Rules not processed for user `b2d1e0f4ad704ad3a1a7221860a2cc91`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:24.145339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-aef36880-5547-4487-8348-7066eb74164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:24.220588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1116/2235] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:24.222039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189c94-8dad-49f1-9f21-8d20deba1584 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.222328 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189c94-8dad-49f1-9f21-8d20deba1584 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.222602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189c94-8dad-49f1-9f21-8d20deba1584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.239259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1120/2236] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:23 2022] DELETE /identity/v3/users/f70d5a209ee74696b3db8de46c7a8842 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:24.240626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6e760-0b39-4a17-aa36-7fcb708d3e41 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.240910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6e760-0b39-4a17-aa36-7fcb708d3e41 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.241181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6e760-0b39-4a17-aa36-7fcb708d3e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.248984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b9189c94-8dad-49f1-9f21-8d20deba1584 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:24.250248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b9189c94-8dad-49f1-9f21-8d20deba1584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:24.282691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3fe6e760-0b39-4a17-aa36-7fcb708d3e41 None None] MFA Rules not processed for user `e21742c06a4247078e56958e53747c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:24.284356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3fe6e760-0b39-4a17-aa36-7fcb708d3e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:24.352510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1117/2237] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:24.361598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747748e-fd87-46ac-b7d6-a4d40f98eb5e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.361881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747748e-fd87-46ac-b7d6-a4d40f98eb5e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.362687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747748e-fd87-46ac-b7d6-a4d40f98eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.367760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1121/2238] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:24.381532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6e760-0b39-4a17-aa36-7fcb708d3e41 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:24.383705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3fe6e760-0b39-4a17-aa36-7fcb708d3e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:24.393670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9747748e-fd87-46ac-b7d6-a4d40f98eb5e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:24.396934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9747748e-fd87-46ac-b7d6-a4d40f98eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:24.412350 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1118/2239] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:24.413681 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747748e-fd87-46ac-b7d6-a4d40f98eb5e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:24.426920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747748e-fd87-46ac-b7d6-a4d40f98eb5e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:24.432548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:24.433167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.433443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.433714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.434410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:24.434712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:24.436290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:24.451105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1119/2240] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:24.457240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:24.467299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38809c-7d28-4c47-ab8f-4c1dbf1c346e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:24.472620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:24.473221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.473502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.473771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.474438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:24.476406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:24.478758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6e760-0b39-4a17-aa36-7fcb708d3e41 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:24.488955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:24.489776 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.490224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.490661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.492673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:24.504655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:24.506661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:24.518954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1122/2241] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:24.600809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1120/2242] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:24 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:41:24.605303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:24.621733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:24.623556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab8b81-3bc5-4326-b688-b3c27baba04c service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:24.719024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:24.719024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:24.759227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23b2ff-26f9-481f-a8e7-ca2758391145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:24.760490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23b2ff-26f9-481f-a8e7-ca2758391145 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.760923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23b2ff-26f9-481f-a8e7-ca2758391145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.761348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23b2ff-26f9-481f-a8e7-ca2758391145 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.762590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23b2ff-26f9-481f-a8e7-ca2758391145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:24.765525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23b2ff-26f9-481f-a8e7-ca2758391145 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:24.801620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21e8a-fe53-483e-a250-2b1db1cb4f90 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:24.833405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:24.834181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.835228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.835498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] PATH_INFO: `/v3/users/c011cfa3d7da4eed834a14221d34d50b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.837311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c011cfa3d7da4eed834a14221d34d50b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:24.840223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:24.882421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1123/2243] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:24 2022] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:24.883357 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23b2ff-26f9-481f-a8e7-ca2758391145 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:24.901855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23b2ff-26f9-481f-a8e7-ca2758391145 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:24.910099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:24.910730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.911060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.911338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.911994 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:24.913599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:24.941438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1124/2244] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:24.941438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:24.946440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:24.967288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd25de-3c85-4eab-a138-638013212074 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:24.976764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:24.977652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:24.977930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:24.978252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] PATH_INFO: `/v3/projects/04d103f3c2ae4137aaebb23ad13deccc` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:24.979792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d103f3c2ae4137aaebb23ad13deccc)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:24.982058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:25.145650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c011cfa3d7da4eed834a14221d34d50b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.160194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c011cfa3d7da4eed834a14221d34d50b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.187599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d103f3c2ae4137aaebb23ad13deccc', 'request_id': 'req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.271108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c011cfa3d7da4eed834a14221d34d50b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.272408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c011cfa3d7da4eed834a14221d34d50b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.284042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c011cfa3d7da4eed834a14221d34d50b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.300141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1121/2245] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:24 2022] DELETE /identity/v3/users/c011cfa3d7da4eed834a14221d34d50b => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:25.301405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:25.303179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:25.333474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d103f3c2ae4137aaebb23ad13deccc', 'request_id': 'req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.346872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d103f3c2ae4137aaebb23ad13deccc', 'request_id': 'req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.366529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] The token cache is being invalidate because project 04d103f3c2ae4137aaebb23ad13deccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:25.366826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.367560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-51d64cb7-bbf8-4aec-aa90-249dc7ed7f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:25.369757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1125/2246] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:24 2022] DELETE /identity/v3/projects/04d103f3c2ae4137aaebb23ad13deccc => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:25.372204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85f41-1a24-4624-9ba8-ddd04a9273df None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:25.373944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85f41-1a24-4624-9ba8-ddd04a9273df None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:25.374289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85f41-1a24-4624-9ba8-ddd04a9273df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:25.399607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e6d85f41-1a24-4624-9ba8-ddd04a9273df None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:25.401016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e6d85f41-1a24-4624-9ba8-ddd04a9273df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:25.462479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433171f6-fa84-4d72-afda-3718678abc6e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:25.478986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f3461-b5f9-4376-918b-6eada0cc4bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:25.479614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f3461-b5f9-4376-918b-6eada0cc4bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:25.480341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f3461-b5f9-4376-918b-6eada0cc4bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:25.480635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f3461-b5f9-4376-918b-6eada0cc4bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:25.481294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f3461-b5f9-4376-918b-6eada0cc4bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:25.486252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f3461-b5f9-4376-918b-6eada0cc4bc9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:25.500569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1122/2247] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:25.503680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75b0dc-73d3-49da-b499-5e90b6d79112 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:25.503680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75b0dc-73d3-49da-b499-5e90b6d79112 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:25.503680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75b0dc-73d3-49da-b499-5e90b6d79112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:25.535500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1126/2248] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:25.536423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85f41-1a24-4624-9ba8-ddd04a9273df None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:25.537826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e6d85f41-1a24-4624-9ba8-ddd04a9273df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:25.554190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85f41-1a24-4624-9ba8-ddd04a9273df None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:25.560748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553e21b-ba0b-413c-ac74-9a29833d890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:25.563025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e21b-ba0b-413c-ac74-9a29833d890b admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:25.563304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-bf75b0dc-73d3-49da-b499-5e90b6d79112 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:25.563761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e21b-ba0b-413c-ac74-9a29833d890b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:25.564695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e21b-ba0b-413c-ac74-9a29833d890b admin admin] PATH_INFO: `/v3/projects/89bc36e60d974759b875af4519170712/users/f25f99e4923b4ae0a5587c63a79302d1/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:25.567027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bf75b0dc-73d3-49da-b499-5e90b6d79112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:25.588299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1123/2249] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:25.589652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75b0dc-73d3-49da-b499-5e90b6d79112 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:25.590109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553e21b-ba0b-413c-ac74-9a29833d890b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bc36e60d974759b875af4519170712, user_id=f25f99e4923b4ae0a5587c63a79302d1, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:25.593186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bf75b0dc-73d3-49da-b499-5e90b6d79112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:25.594293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553e21b-ba0b-413c-ac74-9a29833d890b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:25.702006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75b0dc-73d3-49da-b499-5e90b6d79112 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:25.706676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1127/2250] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:25 2022] PUT /identity/v3/projects/89bc36e60d974759b875af4519170712/users/f25f99e4923b4ae0a5587c63a79302d1/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:25.709016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065614c-127c-4291-8263-1cefb48491b7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:25.709488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065614c-127c-4291-8263-1cefb48491b7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:25.709939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065614c-127c-4291-8263-1cefb48491b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:25.750970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5065614c-127c-4291-8263-1cefb48491b7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:25.752209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5065614c-127c-4291-8263-1cefb48491b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:25.767743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:25.796138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931e7f2-dd94-498b-88da-8ce58f5b0040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:25.797118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e7f2-dd94-498b-88da-8ce58f5b0040 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:25.797404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e7f2-dd94-498b-88da-8ce58f5b0040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:25.797682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931e7f2-dd94-498b-88da-8ce58f5b0040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:25.818844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:25.874704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1128/2251] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:25.876802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bd0b-fa6e-4b91-974a-5a5fd005a544 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:25.877252 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bd0b-fa6e-4b91-974a-5a5fd005a544 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:25.878596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164bd0b-fa6e-4b91-974a-5a5fd005a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:25.948994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931e7f2-dd94-498b-88da-8ce58f5b0040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:25.951157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931e7f2-dd94-498b-88da-8ce58f5b0040 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:25.952148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7164bd0b-fa6e-4b91-974a-5a5fd005a544 None None] MFA Rules not processed for user `f25f99e4923b4ae0a5587c63a79302d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:25.953684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7164bd0b-fa6e-4b91-974a-5a5fd005a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:25.966139 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1124/2252] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:25.967622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931e7f2-dd94-498b-88da-8ce58f5b0040 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:25.981821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931e7f2-dd94-498b-88da-8ce58f5b0040 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:25.991162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:25.991933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:25.996465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:25.996465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:25.996465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:25.996465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:25.996465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:26.018849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1125/2253] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:26.023430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:26.046983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee41f6-796e-4dc1-a3d2-c15820827cb2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:26.061120 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e7ac6-4ef2-4d25-a651-927521a2c703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:26.063409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e7ac6-4ef2-4d25-a651-927521a2c703 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:26.063677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e7ac6-4ef2-4d25-a651-927521a2c703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:26.063965 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e7ac6-4ef2-4d25-a651-927521a2c703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:26.066613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e7ac6-4ef2-4d25-a651-927521a2c703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:26.070704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e7ac6-4ef2-4d25-a651-927521a2c703 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:26.089578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1129/2254] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:26.103231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164bd0b-fa6e-4b91-974a-5a5fd005a544 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:26.112942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7164bd0b-fa6e-4b91-974a-5a5fd005a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:26.175903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164bd0b-fa6e-4b91-974a-5a5fd005a544 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:26.179614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e64c5-6735-4aec-96cf-1612a2af2466 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dca3ee8b78402eb95815eb200d90a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:26.180220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e64c5-6735-4aec-96cf-1612a2af2466 service glance] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:26.180496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e64c5-6735-4aec-96cf-1612a2af2466 service glance] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:26.180765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e64c5-6735-4aec-96cf-1612a2af2466 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:26.189358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e64c5-6735-4aec-96cf-1612a2af2466 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:26.190862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e64c5-6735-4aec-96cf-1612a2af2466 service glance] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:26.200619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1130/2255] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:26.218936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1126/2256] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:26 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:41:26.224171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e64c5-6735-4aec-96cf-1612a2af2466 service glance] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:26.236888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e64c5-6735-4aec-96cf-1612a2af2466 service glance] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:26.316812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde26b-39f2-4b62-8356-6014404f3c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:26.317965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde26b-39f2-4b62-8356-6014404f3c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:26.317965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde26b-39f2-4b62-8356-6014404f3c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:26.318145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acde26b-39f2-4b62-8356-6014404f3c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:26.318813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acde26b-39f2-4b62-8356-6014404f3c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:26.321302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acde26b-39f2-4b62-8356-6014404f3c9e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:26.428701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1131/2257] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:26 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:26.433143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e7ac6-4ef2-4d25-a651-927521a2c703 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:26.458446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e7ac6-4ef2-4d25-a651-927521a2c703 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:26.474881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc1f7b-01d3-44a4-bdd8-51c946074343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:26.474881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1f7b-01d3-44a4-bdd8-51c946074343 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:26.474881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1f7b-01d3-44a4-bdd8-51c946074343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:26.474881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1f7b-01d3-44a4-bdd8-51c946074343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:26.475302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc1f7b-01d3-44a4-bdd8-51c946074343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:26.475854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc1f7b-01d3-44a4-bdd8-51c946074343 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:26.488743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1127/2258] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:26.492891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde26b-39f2-4b62-8356-6014404f3c9e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:26.509343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acde26b-39f2-4b62-8356-6014404f3c9e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:26.509683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8c3b0-e4f5-42fe-9aae-b07289f9d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:26.510552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c3b0-e4f5-42fe-9aae-b07289f9d137 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:26.510837 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c3b0-e4f5-42fe-9aae-b07289f9d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:26.511113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8c3b0-e4f5-42fe-9aae-b07289f9d137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:26.511767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8c3b0-e4f5-42fe-9aae-b07289f9d137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:26.513377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8c3b0-e4f5-42fe-9aae-b07289f9d137 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:26.525057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1132/2259] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:41:26.530105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc1f7b-01d3-44a4-bdd8-51c946074343 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:26.545556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc1f7b-01d3-44a4-bdd8-51c946074343 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:26.569412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:26.570341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:26.570769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:26.571767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] PATH_INFO: `/v3/projects/ee050cc33ed54b6d999fef78b8a3b439/users/0fd76c677f5f4ca5a61a3da7ed96e32a/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:26.647949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee050cc33ed54b6d999fef78b8a3b439, user_id=0fd76c677f5f4ca5a61a3da7ed96e32a, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:26.652078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:26.883966 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1128/2260] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:26 2022] PUT /identity/v3/projects/ee050cc33ed54b6d999fef78b8a3b439/users/0fd76c677f5f4ca5a61a3da7ed96e32a/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:26.896058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b09c6-c47e-4751-b205-01e5ac50e5ec None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:26.897172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b09c6-c47e-4751-b205-01e5ac50e5ec None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:26.897172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b09c6-c47e-4751-b205-01e5ac50e5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:26.953837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:26.956347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:26.961526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1c8b09c6-c47e-4751-b205-01e5ac50e5ec None None] MFA Rules not processed for user `0fd76c677f5f4ca5a61a3da7ed96e32a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:26.963158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1c8b09c6-c47e-4751-b205-01e5ac50e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:27.053511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1133/2261] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:27.058241 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d389fb-054b-426f-bc07-9cd996e361ef admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:27.063697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:27.064425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:27.065304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:27.067425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] PATH_INFO: `/v3/projects/7c3cb3919a36440bacf310ed217cdadc` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:27.067561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b09c6-c47e-4751-b205-01e5ac50e5ec None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:27.067660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3cb3919a36440bacf310ed217cdadc)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:27.067747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1c8b09c6-c47e-4751-b205-01e5ac50e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:27.068844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:27.132033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b09c6-c47e-4751-b205-01e5ac50e5ec None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:27.136186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c333ac9-ff7e-4fdf-b9b8-5123978203b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dca3ee8b78402eb95815eb200d90a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:27.136514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c333ac9-ff7e-4fdf-b9b8-5123978203b0 service glance] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:27.136705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c333ac9-ff7e-4fdf-b9b8-5123978203b0 service glance] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:27.137066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c333ac9-ff7e-4fdf-b9b8-5123978203b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:27.146695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c333ac9-ff7e-4fdf-b9b8-5123978203b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:27.148137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c333ac9-ff7e-4fdf-b9b8-5123978203b0 service glance] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:27.158407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1134/2262] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:41:27.252285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3cb3919a36440bacf310ed217cdadc', 'request_id': 'req-634df398-0911-40ec-a632-ea6491cd8358'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:27.373746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3cb3919a36440bacf310ed217cdadc', 'request_id': 'req-634df398-0911-40ec-a632-ea6491cd8358'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:27.384035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3cb3919a36440bacf310ed217cdadc', 'request_id': 'req-634df398-0911-40ec-a632-ea6491cd8358'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:27.398345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] The token cache is being invalidate because project 7c3cb3919a36440bacf310ed217cdadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:27.398642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:27.399359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-634df398-0911-40ec-a632-ea6491cd8358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:27.401143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1129/2263] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:26 2022] DELETE /identity/v3/projects/7c3cb3919a36440bacf310ed217cdadc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:27.412154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d3fd-1cc5-4e77-86f4-91bd9c2e9eac None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:27.412154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d3fd-1cc5-4e77-86f4-91bd9c2e9eac None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:27.412154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d3fd-1cc5-4e77-86f4-91bd9c2e9eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:27.426539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6009d3fd-1cc5-4e77-86f4-91bd9c2e9eac None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:27.427753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6009d3fd-1cc5-4e77-86f4-91bd9c2e9eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:27.492768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1135/2264] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:27.500391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585f17-7ab5-4b8d-8a90-223d9109aac8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:27.500918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585f17-7ab5-4b8d-8a90-223d9109aac8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:27.510417 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d585f17-7ab5-4b8d-8a90-223d9109aac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:27.536392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3d585f17-7ab5-4b8d-8a90-223d9109aac8 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:27.537675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3d585f17-7ab5-4b8d-8a90-223d9109aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:27.545755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1130/2265] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:27.551047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d3fd-1cc5-4e77-86f4-91bd9c2e9eac None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:27.561018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d3fd-1cc5-4e77-86f4-91bd9c2e9eac None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:27.566403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:27.567027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:27.567310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:27.567583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:27.568233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:27.568539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:27.570418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:27.583710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1136/2266] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:41:27.590174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d585f17-7ab5-4b8d-8a90-223d9109aac8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:27.599558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d585f17-7ab5-4b8d-8a90-223d9109aac8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:27.604404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b2f2-6dec-4e40-844c-c900ddf5d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:27.604998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b2f2-6dec-4e40-844c-c900ddf5d162 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:27.605279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b2f2-6dec-4e40-844c-c900ddf5d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:27.605723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2b2f2-6dec-4e40-844c-c900ddf5d162 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:27.606313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2b2f2-6dec-4e40-844c-c900ddf5d162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:27.608237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2b2f2-6dec-4e40-844c-c900ddf5d162 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:27.795579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1131/2267] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:27 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:27.800956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:27.813569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb04d5-2c82-46ad-a0de-12c2571ac093 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:27.873430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81c8e9-ccb2-408d-9566-9f8f6461ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:27.874062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81c8e9-ccb2-408d-9566-9f8f6461ef05 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:27.874344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81c8e9-ccb2-408d-9566-9f8f6461ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:27.874622 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81c8e9-ccb2-408d-9566-9f8f6461ef05 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:27.875233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81c8e9-ccb2-408d-9566-9f8f6461ef05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:27.877113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81c8e9-ccb2-408d-9566-9f8f6461ef05 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:27.984889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1137/2268] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:27 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:27.989741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b2f2-6dec-4e40-844c-c900ddf5d162 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:27.999809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2b2f2-6dec-4e40-844c-c900ddf5d162 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:28.004765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c6f81-66bc-44b5-a41c-96b6c335079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:28.005333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c6f81-66bc-44b5-a41c-96b6c335079d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:28.005644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c6f81-66bc-44b5-a41c-96b6c335079d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:28.005940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c6f81-66bc-44b5-a41c-96b6c335079d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:28.006542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c6f81-66bc-44b5-a41c-96b6c335079d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:28.008102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c6f81-66bc-44b5-a41c-96b6c335079d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:28.019144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1132/2269] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:28.023168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81c8e9-ccb2-408d-9566-9f8f6461ef05 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:28.034347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81c8e9-ccb2-408d-9566-9f8f6461ef05 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:28.040425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340eb5e7-71dd-4f39-9be2-7eb83561e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:28.041301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb5e7-71dd-4f39-9be2-7eb83561e9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:28.041690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb5e7-71dd-4f39-9be2-7eb83561e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:28.041971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb5e7-71dd-4f39-9be2-7eb83561e9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:28.052037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340eb5e7-71dd-4f39-9be2-7eb83561e9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:28.052037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340eb5e7-71dd-4f39-9be2-7eb83561e9e6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:28.057734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1138/2270] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:28.061731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c6f81-66bc-44b5-a41c-96b6c335079d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:28.074622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c6f81-66bc-44b5-a41c-96b6c335079d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:28.080852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:28.082009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:28.082009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:28.082231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] PATH_INFO: `/v3/projects/c33c69d186064cd2b573e650533ea722/users/76bc3d333268404ca5b3e337f2aa363c/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:28.104217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33c69d186064cd2b573e650533ea722, user_id=76bc3d333268404ca5b3e337f2aa363c, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:28.107085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:28.127855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:28.293207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1133/2271] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:28 2022] PUT /identity/v3/projects/c33c69d186064cd2b573e650533ea722/users/76bc3d333268404ca5b3e337f2aa363c/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:28.304212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b425-5603-4cfa-9d5c-3489f472bd54 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:28.304421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b425-5603-4cfa-9d5c-3489f472bd54 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:28.304692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0b425-5603-4cfa-9d5c-3489f472bd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:28.337828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5cb0b425-5603-4cfa-9d5c-3489f472bd54 None None] MFA Rules not processed for user `76bc3d333268404ca5b3e337f2aa363c`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:28.339194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5cb0b425-5603-4cfa-9d5c-3489f472bd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:28.426632 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1139/2272] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:41:28.438630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:28.440827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:28.516631 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c85c1-e2e9-43b8-8180-7a58eeff5e54 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:28.521538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dee29a-4799-4e95-9ca4-99205d36749d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:28.522194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dee29a-4799-4e95-9ca4-99205d36749d service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:28.522501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dee29a-4799-4e95-9ca4-99205d36749d service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:28.522784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dee29a-4799-4e95-9ca4-99205d36749d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:28.534971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:28.535199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dee29a-4799-4e95-9ca4-99205d36749d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:28.536696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dee29a-4799-4e95-9ca4-99205d36749d service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:28.546426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1134/2273] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:41:30.447470 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:32.384664 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:33.082402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:34.407954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:34.791202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:36.688288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:37.265018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:38.790884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:39.446919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:41.475867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:41.942847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:42.122873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebf05-c83c-4592-aa58-90a0e6f336ff None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:42.123712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebf05-c83c-4592-aa58-90a0e6f336ff None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:42.124372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ebf05-c83c-4592-aa58-90a0e6f336ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:42.172710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-526ebf05-c83c-4592-aa58-90a0e6f336ff None None] MFA Rules not processed for user `e4c7cd885cc24bf2934e4e9cecb50ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:42.174579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-526ebf05-c83c-4592-aa58-90a0e6f336ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:42.316677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1140/2274] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:44.471008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:44.807501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:45.011080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dee29a-4799-4e95-9ca4-99205d36749d service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:45.106531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dee29a-4799-4e95-9ca4-99205d36749d service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:45.112208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:45.112872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:45.113230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:45.113513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] PATH_INFO: `/v3/users/76bc3d333268404ca5b3e337f2aa363c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:45.114852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=76bc3d333268404ca5b3e337f2aa363c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:45.116855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:45.400744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76bc3d333268404ca5b3e337f2aa363c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:45.414606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76bc3d333268404ca5b3e337f2aa363c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:45.509843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76bc3d333268404ca5b3e337f2aa363c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:45.514158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76bc3d333268404ca5b3e337f2aa363c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:45.519217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76bc3d333268404ca5b3e337f2aa363c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:45.526267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1135/2275] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:45 2022] DELETE /identity/v3/users/76bc3d333268404ca5b3e337f2aa363c => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:45.531253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130698-6b3e-413d-8624-53c8509a7102 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:45.531741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130698-6b3e-413d-8624-53c8509a7102 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:45.531844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130698-6b3e-413d-8624-53c8509a7102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:45.551192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-29130698-6b3e-413d-8624-53c8509a7102 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:45.552399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-29130698-6b3e-413d-8624-53c8509a7102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:45.615204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1141/2276] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:41:45.624540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:45.626010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:45.706791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cb9c1-bb97-454f-bbbd-f936a6074aff admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:45.714091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a88f4-1b06-4de2-8c87-740e6ed05ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:45.715119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a88f4-1b06-4de2-8c87-740e6ed05ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:45.715119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a88f4-1b06-4de2-8c87-740e6ed05ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:45.715383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a88f4-1b06-4de2-8c87-740e6ed05ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:45.734756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a88f4-1b06-4de2-8c87-740e6ed05ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:45.734756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a88f4-1b06-4de2-8c87-740e6ed05ed5 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:45.742731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1136/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:46.231387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29130698-6b3e-413d-8624-53c8509a7102 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:46.233290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-29130698-6b3e-413d-8624-53c8509a7102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:46.247141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29130698-6b3e-413d-8624-53c8509a7102 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:46.254412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:46.255185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:46.255528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:46.255797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] PATH_INFO: `/v3/projects/c33c69d186064cd2b573e650533ea722` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:46.257726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33c69d186064cd2b573e650533ea722)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:46.260224 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:46.327453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:46.386331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33c69d186064cd2b573e650533ea722', 'request_id': 'req-30f25a54-efef-4eb6-9af8-8f5f07c9a018'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:46.481220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33c69d186064cd2b573e650533ea722', 'request_id': 'req-30f25a54-efef-4eb6-9af8-8f5f07c9a018'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:46.489653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33c69d186064cd2b573e650533ea722', 'request_id': 'req-30f25a54-efef-4eb6-9af8-8f5f07c9a018'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:46.504475 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] The token cache is being invalidate because project c33c69d186064cd2b573e650533ea722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:46.504772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:46.505446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30f25a54-efef-4eb6-9af8-8f5f07c9a018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:46.507070 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1142/2278] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:46 2022] DELETE /identity/v3/projects/c33c69d186064cd2b573e650533ea722 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:46.512638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84111-72d5-4892-954f-78f5360b0def None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:46.513595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84111-72d5-4892-954f-78f5360b0def None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:46.513807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84111-72d5-4892-954f-78f5360b0def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:46.535766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2cd84111-72d5-4892-954f-78f5360b0def None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:46.537059 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2cd84111-72d5-4892-954f-78f5360b0def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:46.595031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:46.613914 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1137/2279] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:46.621608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147c941-c9ee-42d7-99a3-24e52603f33d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:46.622121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147c941-c9ee-42d7-99a3-24e52603f33d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:46.622257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147c941-c9ee-42d7-99a3-24e52603f33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:46.647038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5147c941-c9ee-42d7-99a3-24e52603f33d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:46.648319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5147c941-c9ee-42d7-99a3-24e52603f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:46.656504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1143/2280] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:46.661815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84111-72d5-4892-954f-78f5360b0def None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:46.671859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84111-72d5-4892-954f-78f5360b0def None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:46.677278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:46.677898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:46.678215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:46.678493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:46.679163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:46.679471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:46.681069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:46.693652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1138/2281] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:46.698391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147c941-c9ee-42d7-99a3-24e52603f33d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:46.708421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147c941-c9ee-42d7-99a3-24e52603f33d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:46.713191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d82721-1060-456a-8994-6998a39c5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:46.713913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d82721-1060-456a-8994-6998a39c5ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:46.714125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d82721-1060-456a-8994-6998a39c5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:46.714401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d82721-1060-456a-8994-6998a39c5ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:46.715060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d82721-1060-456a-8994-6998a39c5ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:46.716987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d82721-1060-456a-8994-6998a39c5ae9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:46.798554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1144/2282] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:46 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:46.803544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:46.815413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0e27-8b9d-462d-89cf-3ed5cdd8a687 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:46.880972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629c1ee-63ba-4c18-a303-77015a12b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:46.881628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c1ee-63ba-4c18-a303-77015a12b62b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:46.881913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c1ee-63ba-4c18-a303-77015a12b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:46.882389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629c1ee-63ba-4c18-a303-77015a12b62b admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:46.883169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629c1ee-63ba-4c18-a303-77015a12b62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:46.885114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629c1ee-63ba-4c18-a303-77015a12b62b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:46.989953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d82721-1060-456a-8994-6998a39c5ae9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:46.990828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1139/2283] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:46 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:47.005229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d82721-1060-456a-8994-6998a39c5ae9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:47.010547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699e27-570f-47bc-b820-0dd1122c0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:47.011284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699e27-570f-47bc-b820-0dd1122c0917 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:47.011561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699e27-570f-47bc-b820-0dd1122c0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:47.011831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699e27-570f-47bc-b820-0dd1122c0917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:47.012480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2699e27-570f-47bc-b820-0dd1122c0917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:47.014104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2699e27-570f-47bc-b820-0dd1122c0917 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:47.025046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1145/2284] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:47.029071 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629c1ee-63ba-4c18-a303-77015a12b62b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:47.039849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629c1ee-63ba-4c18-a303-77015a12b62b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:47.044423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090057a-6b54-4afd-aa88-e2047fcac6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:47.045018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090057a-6b54-4afd-aa88-e2047fcac6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:47.045300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090057a-6b54-4afd-aa88-e2047fcac6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:47.045570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090057a-6b54-4afd-aa88-e2047fcac6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:47.046239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090057a-6b54-4afd-aa88-e2047fcac6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:47.050524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090057a-6b54-4afd-aa88-e2047fcac6a6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:47.058942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1140/2285] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:47.063222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699e27-570f-47bc-b820-0dd1122c0917 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:47.073846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699e27-570f-47bc-b820-0dd1122c0917 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:47.078540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:47.085315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:47.085315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:47.085315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] PATH_INFO: `/v3/projects/85216b6544be4d43abc5ab10a15e93e2/users/f818e4ca845c474081b7c49994ee3737/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:47.099355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85216b6544be4d43abc5ab10a15e93e2, user_id=f818e4ca845c474081b7c49994ee3737, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:47.102001 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:47.168012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1146/2286] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:47 2022] PUT /identity/v3/projects/85216b6544be4d43abc5ab10a15e93e2/users/f818e4ca845c474081b7c49994ee3737/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:47.172935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857d15-7a23-4498-a7d9-082a86e16f4b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:47.173292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857d15-7a23-4498-a7d9-082a86e16f4b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:47.173705 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857d15-7a23-4498-a7d9-082a86e16f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:47.195813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-63857d15-7a23-4498-a7d9-082a86e16f4b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:47.197122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-63857d15-7a23-4498-a7d9-082a86e16f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:47.272908 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1141/2287] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:47.286652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:47.288394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:47.323130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:47.354234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb688be-3924-4a7b-87c9-9c0ad8af8078 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:47.358481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:47.359141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:47.359423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:47.359699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:47.369741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:47.372691 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:47.385020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1147/2288] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:47.402036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:47.704983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065c20-dabb-489a-8022-9472b755b9fc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:47.705805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065c20-dabb-489a-8022-9472b755b9fc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:47.705805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04065c20-dabb-489a-8022-9472b755b9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:47.730481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-04065c20-dabb-489a-8022-9472b755b9fc None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:47.730481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-04065c20-dabb-489a-8022-9472b755b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:47.798086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1142/2289] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:47.824497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:47.865687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:47.867763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:47.996904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247653cb-868c-4ce3-a917-721f20912edb service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:48.007404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3406a04-b541-4ee9-b738-57c3077c45c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:48.008318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3406a04-b541-4ee9-b738-57c3077c45c5 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:48.011105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3406a04-b541-4ee9-b738-57c3077c45c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:48.017231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3406a04-b541-4ee9-b738-57c3077c45c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:48.030967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3406a04-b541-4ee9-b738-57c3077c45c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:48.034176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3406a04-b541-4ee9-b738-57c3077c45c5 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:48.049268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1148/2290] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:41:48.544856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:48.848248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:49.273793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7115-1189-4f5f-920b-0389446c0891 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:49.274108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7115-1189-4f5f-920b-0389446c0891 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:49.274546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7115-1189-4f5f-920b-0389446c0891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:49.295122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f09c7115-1189-4f5f-920b-0389446c0891 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:49.296353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f09c7115-1189-4f5f-920b-0389446c0891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:49.305185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1143/2291] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 22 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:49.319825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3406a04-b541-4ee9-b738-57c3077c45c5 service swift] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:49.334749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3406a04-b541-4ee9-b738-57c3077c45c5 service swift] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:49.343877 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:49.344569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:49.344866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:49.345313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:49.373488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:49.373488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:49.383097 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1149/2292] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:41:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:41:49.619063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60c467-5d5b-4851-bce4-79833c28985c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:49.619340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60c467-5d5b-4851-bce4-79833c28985c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:49.619617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60c467-5d5b-4851-bce4-79833c28985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:49.639594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:49.659427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-bd60c467-5d5b-4851-bce4-79833c28985c None None] MFA Rules not processed for user `f818e4ca845c474081b7c49994ee3737`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:49.660977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bd60c467-5d5b-4851-bce4-79833c28985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:49.737746 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1144/2293] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:49.750360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:49.753511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:49.821500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ade2b-65e4-4e60-b9a8-24983aae82c4 service swift] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:49.826131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6b427-f030-4c4b-ad25-c2dcefa4e650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:49.826788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6b427-f030-4c4b-ad25-c2dcefa4e650 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:49.827072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6b427-f030-4c4b-ad25-c2dcefa4e650 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:49.827373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6b427-f030-4c4b-ad25-c2dcefa4e650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:49.838739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6b427-f030-4c4b-ad25-c2dcefa4e650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:49.847642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6b427-f030-4c4b-ad25-c2dcefa4e650 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:49.851190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1150/2294] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:50.151737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19225ab-6309-4271-93cf-b62478f18436 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:50.152180 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19225ab-6309-4271-93cf-b62478f18436 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:50.152400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19225ab-6309-4271-93cf-b62478f18436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:50.178265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a19225ab-6309-4271-93cf-b62478f18436 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:50.181057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a19225ab-6309-4271-93cf-b62478f18436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:50.189848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1145/2295] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:50.204429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6b427-f030-4c4b-ad25-c2dcefa4e650 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:50.217376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6b427-f030-4c4b-ad25-c2dcefa4e650 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:50.224196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d7d9f-647f-4739-89cb-807bfbae0c35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:50.224843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d7d9f-647f-4739-89cb-807bfbae0c35 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:50.225127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d7d9f-647f-4739-89cb-807bfbae0c35 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:50.225402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d7d9f-647f-4739-89cb-807bfbae0c35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:50.234789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d7d9f-647f-4739-89cb-807bfbae0c35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:50.237019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d7d9f-647f-4739-89cb-807bfbae0c35 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:50.246375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1151/2296] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:41:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:41:50.567490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:50.942413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89435aea-0e1d-4ce6-81ad-42f4ee5b3bec None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:50.942623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89435aea-0e1d-4ce6-81ad-42f4ee5b3bec None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:50.942895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89435aea-0e1d-4ce6-81ad-42f4ee5b3bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:50.965790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-89435aea-0e1d-4ce6-81ad-42f4ee5b3bec None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:50.967351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-89435aea-0e1d-4ce6-81ad-42f4ee5b3bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:50.976475 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1146/2297] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 22 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:50.991139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d7d9f-647f-4739-89cb-807bfbae0c35 service swift] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:51.003019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d7d9f-647f-4739-89cb-807bfbae0c35 service swift] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:51.008359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:51.009034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:51.009316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:51.009615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:51.018859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:51.020448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:51.029378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1152/2298] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:41:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:41:51.162088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:51.725587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaea42-d734-4e62-8fa5-8d8e2e6978cf None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:51.726248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaea42-d734-4e62-8fa5-8d8e2e6978cf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:51.726248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaea42-d734-4e62-8fa5-8d8e2e6978cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:51.748765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f6eaea42-d734-4e62-8fa5-8d8e2e6978cf None None] MFA Rules not processed for user `f818e4ca845c474081b7c49994ee3737`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:51.750261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f6eaea42-d734-4e62-8fa5-8d8e2e6978cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:51.758363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1147/2299] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:41:52.539471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:52.898962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:54.201557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:54.203154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:54.221147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfd2f8-0fbd-4194-8808-aaadc1c4560b service swift] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:54.234637 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:54.236040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:54.236706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:54.236913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] PATH_INFO: `/v3/users/b2beb83cd682459d8e8c1548696ab046` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:54.238292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2beb83cd682459d8e8c1548696ab046)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:54.240301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:54.493062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:54.510910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2beb83cd682459d8e8c1548696ab046'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:54.511580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2beb83cd682459d8e8c1548696ab046'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:54.519144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2beb83cd682459d8e8c1548696ab046'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:54.531511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2beb83cd682459d8e8c1548696ab046'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:54.536619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2beb83cd682459d8e8c1548696ab046'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:54.641690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1153/2300] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:41:54 2022] DELETE /identity/v3/users/b2beb83cd682459d8e8c1548696ab046 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:54.646259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aceff1-e6dc-4405-8fdf-8b3d156144d6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:54.646755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aceff1-e6dc-4405-8fdf-8b3d156144d6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:54.646890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aceff1-e6dc-4405-8fdf-8b3d156144d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:54.670248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-20aceff1-e6dc-4405-8fdf-8b3d156144d6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:54.671484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-20aceff1-e6dc-4405-8fdf-8b3d156144d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:54.758682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1148/2301] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:54.765418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:54.767623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:54.858840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a09f70-688c-40ec-832f-87ea75a3a243 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:54.866938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3915c8-6340-4928-b2c4-1803b7be940f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:54.867618 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3915c8-6340-4928-b2c4-1803b7be940f service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:54.867904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3915c8-6340-4928-b2c4-1803b7be940f service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:54.868178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3915c8-6340-4928-b2c4-1803b7be940f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:54.879532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3915c8-6340-4928-b2c4-1803b7be940f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:54.881284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3915c8-6340-4928-b2c4-1803b7be940f service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:54.893601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1154/2302] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:41:55.231279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aceff1-e6dc-4405-8fdf-8b3d156144d6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:55.232738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-20aceff1-e6dc-4405-8fdf-8b3d156144d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:55.246299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aceff1-e6dc-4405-8fdf-8b3d156144d6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:55.263228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:55.263891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:55.264167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:55.265758 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] PATH_INFO: `/v3/projects/19540ab07f6d4f96ad6a8a92fdee8bfd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:55.267824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19540ab07f6d4f96ad6a8a92fdee8bfd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:55.269755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:55.422342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19540ab07f6d4f96ad6a8a92fdee8bfd', 'request_id': 'req-06a11ea7-a6ae-4590-97eb-2e992e1092b5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:55.521100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19540ab07f6d4f96ad6a8a92fdee8bfd', 'request_id': 'req-06a11ea7-a6ae-4590-97eb-2e992e1092b5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:55.528757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19540ab07f6d4f96ad6a8a92fdee8bfd', 'request_id': 'req-06a11ea7-a6ae-4590-97eb-2e992e1092b5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:55.543971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] The token cache is being invalidate because project 19540ab07f6d4f96ad6a8a92fdee8bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:41:55.544268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:55.545123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-06a11ea7-a6ae-4590-97eb-2e992e1092b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:41:55.546863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1149/2303] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:41:55 2022] DELETE /identity/v3/projects/19540ab07f6d4f96ad6a8a92fdee8bfd => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:41:55.552243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4502630-da27-4f47-bf69-1d28fda0551f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:55.553195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4502630-da27-4f47-bf69-1d28fda0551f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:55.553478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4502630-da27-4f47-bf69-1d28fda0551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:55.574850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e4502630-da27-4f47-bf69-1d28fda0551f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:55.576105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e4502630-da27-4f47-bf69-1d28fda0551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:55.624536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:55.643656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1155/2304] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:55.652306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406e555-463d-40e3-abe0-f3c4ddb1205c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:55.652883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406e555-463d-40e3-abe0-f3c4ddb1205c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:55.652982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406e555-463d-40e3-abe0-f3c4ddb1205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:55.676644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b406e555-463d-40e3-abe0-f3c4ddb1205c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:55.676644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b406e555-463d-40e3-abe0-f3c4ddb1205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:55.685762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1150/2305] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:55.690647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4502630-da27-4f47-bf69-1d28fda0551f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:55.701165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4502630-da27-4f47-bf69-1d28fda0551f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:55.706248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:55.706872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:55.707152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:55.707420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:55.708174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:41:55.708453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:55.710074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:55.727053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1156/2306] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:41:55.728373 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406e555-463d-40e3-abe0-f3c4ddb1205c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:55.741393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406e555-463d-40e3-abe0-f3c4ddb1205c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:55.748160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de799878-3918-4d5e-af4d-8fa826bc9241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:55.748690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de799878-3918-4d5e-af4d-8fa826bc9241 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:55.749140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de799878-3918-4d5e-af4d-8fa826bc9241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:55.749250 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de799878-3918-4d5e-af4d-8fa826bc9241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:55.749879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de799878-3918-4d5e-af4d-8fa826bc9241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:55.752535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de799878-3918-4d5e-af4d-8fa826bc9241 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:55.894880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1151/2307] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:41:55 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:55.899251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:55.910125 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406faaf-7ba6-4cfe-b0c6-8d81d16fd2c2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:55.972627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56a14-adc9-4dea-b5ac-a01575ead492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:55.973171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56a14-adc9-4dea-b5ac-a01575ead492 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:55.973460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56a14-adc9-4dea-b5ac-a01575ead492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:55.973726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c56a14-adc9-4dea-b5ac-a01575ead492 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:55.974423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c56a14-adc9-4dea-b5ac-a01575ead492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:55.976361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c56a14-adc9-4dea-b5ac-a01575ead492 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:56.091989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1157/2308] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:41:55 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:41:56.096934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de799878-3918-4d5e-af4d-8fa826bc9241 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:56.107312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de799878-3918-4d5e-af4d-8fa826bc9241 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:56.113016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efedd3-bf5e-4275-bb0c-b8596f57fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:56.113615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efedd3-bf5e-4275-bb0c-b8596f57fc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:56.113898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efedd3-bf5e-4275-bb0c-b8596f57fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:56.114199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efedd3-bf5e-4275-bb0c-b8596f57fc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:56.114847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efedd3-bf5e-4275-bb0c-b8596f57fc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:56.116452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efedd3-bf5e-4275-bb0c-b8596f57fc94 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:56.127707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1152/2309] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:56.134004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56a14-adc9-4dea-b5ac-a01575ead492 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:56.144461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c56a14-adc9-4dea-b5ac-a01575ead492 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:56.149142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb97b3f-1de8-4d40-a001-d447b4dca877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:56.149749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb97b3f-1de8-4d40-a001-d447b4dca877 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:56.150060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb97b3f-1de8-4d40-a001-d447b4dca877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:56.150335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb97b3f-1de8-4d40-a001-d447b4dca877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:56.150983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb97b3f-1de8-4d40-a001-d447b4dca877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:56.152601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb97b3f-1de8-4d40-a001-d447b4dca877 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:56.167083 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1158/2310] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:41:56.168214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efedd3-bf5e-4275-bb0c-b8596f57fc94 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:56.179343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efedd3-bf5e-4275-bb0c-b8596f57fc94 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:56.184226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:56.192976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:56.192976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:56.192976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] PATH_INFO: `/v3/projects/8807b854790f45509c9695ae7193b4ca/users/12b6287f37d9429e873d1ac7dcebe42c/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:56.205881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8807b854790f45509c9695ae7193b4ca, user_id=12b6287f37d9429e873d1ac7dcebe42c, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:56.209650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:56.282533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1153/2311] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:41:56 2022] PUT /identity/v3/projects/8807b854790f45509c9695ae7193b4ca/users/12b6287f37d9429e873d1ac7dcebe42c/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:41:56.289741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf28d-5515-4151-98f8-0a5d56f2846c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:56.290352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf28d-5515-4151-98f8-0a5d56f2846c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:56.290961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbf28d-5515-4151-98f8-0a5d56f2846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:56.312720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-c8fbf28d-5515-4151-98f8-0a5d56f2846c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:41:56.314746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c8fbf28d-5515-4151-98f8-0a5d56f2846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:56.373928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1159/2312] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:41:56.384832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:56.386776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:56.463809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba7da3-94de-4faf-87df-afb87772c253 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:56.467828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:56.468450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:56.468729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:56.469002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:56.479218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:56.480648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:56.491318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1154/2313] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:56.710067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:57.950027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:41:59.426642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf28d-5515-4151-98f8-0a5d56f2846c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:41:59.428789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c8fbf28d-5515-4151-98f8-0a5d56f2846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:59.516188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbf28d-5515-4151-98f8-0a5d56f2846c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:41:59.521389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e137bb4-ab8e-4bb8-9cc0-987e117c9bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:41:59.522174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e137bb4-ab8e-4bb8-9cc0-987e117c9bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:41:59.522541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e137bb4-ab8e-4bb8-9cc0-987e117c9bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:41:59.522880 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e137bb4-ab8e-4bb8-9cc0-987e117c9bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:41:59.524775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5e137bb4-ab8e-4bb8-9cc0-987e117c9bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:41:59.617443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e137bb4-ab8e-4bb8-9cc0-987e117c9bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:41:59.621554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e137bb4-ab8e-4bb8-9cc0-987e117c9bd2 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:41:59.642177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1160/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:41:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:41:59.831191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:01.826720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:03.113742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:03.115341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:03.129731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcb908-023e-4094-a8f0-561a22af29cb service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:03.149466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:03.150460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:03.150918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:03.151288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] PATH_INFO: `/v3/users/f25f99e4923b4ae0a5587c63a79302d1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:03.152945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25f99e4923b4ae0a5587c63a79302d1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:03.155903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:03.390355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25f99e4923b4ae0a5587c63a79302d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:03.420086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25f99e4923b4ae0a5587c63a79302d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:03.488154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25f99e4923b4ae0a5587c63a79302d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:03.488789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25f99e4923b4ae0a5587c63a79302d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:03.504566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25f99e4923b4ae0a5587c63a79302d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:03.528672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1155/2315] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:42:03 2022] DELETE /identity/v3/users/f25f99e4923b4ae0a5587c63a79302d1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:03.533813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485057d-e3a5-4125-a9d0-423e3171416f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:03.534416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485057d-e3a5-4125-a9d0-423e3171416f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:03.534627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485057d-e3a5-4125-a9d0-423e3171416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:03.583181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f485057d-e3a5-4125-a9d0-423e3171416f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:03.584753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f485057d-e3a5-4125-a9d0-423e3171416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:03.704023 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1161/2316] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:03.744664 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:03.747077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:03.883573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:03.896817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4ee0f-20fc-4510-9d4b-d2f08e6b6d51 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:03.906684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:03.909749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:03.910498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:03.912486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:03.939754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:03.942681 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:03.960611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1156/2317] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:04.736651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ba68-ea51-4357-9d80-92b3a8bada69 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:04.737235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ba68-ea51-4357-9d80-92b3a8bada69 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:04.739092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ba68-ea51-4357-9d80-92b3a8bada69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:04.772081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f4c4ba68-ea51-4357-9d80-92b3a8bada69 None None] MFA Rules not processed for user `12b6287f37d9429e873d1ac7dcebe42c`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:04.773306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4c4ba68-ea51-4357-9d80-92b3a8bada69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:04.867346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1162/2318] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:04.872020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:04.874525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:04.889622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19df45-4512-4095-85cb-4ff4dc6f3a13 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:04.897290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b065e3-0617-447e-b42d-80829fdedd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:04.898741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b065e3-0617-447e-b42d-80829fdedd3d admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:04.899213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b065e3-0617-447e-b42d-80829fdedd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:04.899677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b065e3-0617-447e-b42d-80829fdedd3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:04.901903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b065e3-0617-447e-b42d-80829fdedd3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:04.906268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b065e3-0617-447e-b42d-80829fdedd3d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:04.968634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ba68-ea51-4357-9d80-92b3a8bada69 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:04.970902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f4c4ba68-ea51-4357-9d80-92b3a8bada69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:05.008478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ba68-ea51-4357-9d80-92b3a8bada69 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:05.013414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:05.014110 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.014511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.014935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] PATH_INFO: `/v3/projects/89bc36e60d974759b875af4519170712` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.016117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89bc36e60d974759b875af4519170712)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:05.018220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:05.152952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1157/2319] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:42:04 2022] POST /identity/v3/projects => generated 385 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:42:05.157525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b065e3-0617-447e-b42d-80829fdedd3d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:05.217200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89bc36e60d974759b875af4519170712', 'request_id': 'req-c72062d6-a9aa-4700-801d-f9b09b12e663'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.239663 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b065e3-0617-447e-b42d-80829fdedd3d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:05.327778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89bc36e60d974759b875af4519170712', 'request_id': 'req-c72062d6-a9aa-4700-801d-f9b09b12e663'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.338202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89bc36e60d974759b875af4519170712', 'request_id': 'req-c72062d6-a9aa-4700-801d-f9b09b12e663'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.348642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd2ee-dd73-4c3e-a195-ad20bc118087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:05.349383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd2ee-dd73-4c3e-a195-ad20bc118087 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.349728 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd2ee-dd73-4c3e-a195-ad20bc118087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.350097 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcd2ee-dd73-4c3e-a195-ad20bc118087 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.350847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd2ee-dd73-4c3e-a195-ad20bc118087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:05.352688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] The token cache is being invalidate because project 89bc36e60d974759b875af4519170712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:42:05.352991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.353102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcd2ee-dd73-4c3e-a195-ad20bc118087 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:05.353694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c72062d6-a9aa-4700-801d-f9b09b12e663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.365421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1163/2320] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:42:04 2022] DELETE /identity/v3/projects/89bc36e60d974759b875af4519170712 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:05.368514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbc6e-132f-4aec-9ad6-9bc94de714ee None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.368514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbc6e-132f-4aec-9ad6-9bc94de714ee None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.368514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfbc6e-132f-4aec-9ad6-9bc94de714ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.389690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e6cfbc6e-132f-4aec-9ad6-9bc94de714ee None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:05.391443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e6cfbc6e-132f-4aec-9ad6-9bc94de714ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:05.400046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1164/2321] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:05.408751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc872d7-2a5d-46c6-97e2-19e142ba956d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.409033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc872d7-2a5d-46c6-97e2-19e142ba956d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.409306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc872d7-2a5d-46c6-97e2-19e142ba956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.435653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4fc872d7-2a5d-46c6-97e2-19e142ba956d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:05.436895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4fc872d7-2a5d-46c6-97e2-19e142ba956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:05.445946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1165/2322] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:42:05.450161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc872d7-2a5d-46c6-97e2-19e142ba956d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:05.451587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4fc872d7-2a5d-46c6-97e2-19e142ba956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:05.464117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc872d7-2a5d-46c6-97e2-19e142ba956d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:05.468972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:05.469615 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.470437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.470715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] PATH_INFO: `/v3/users/0fd76c677f5f4ca5a61a3da7ed96e32a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.471896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd76c677f5f4ca5a61a3da7ed96e32a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:05.473868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:05.487723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1158/2323] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:42:05 2022] POST /identity/v3/users => generated 299 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:42:05.490938 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd2ee-dd73-4c3e-a195-ad20bc118087 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:05.505997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcd2ee-dd73-4c3e-a195-ad20bc118087 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:05.515285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:05.515285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.515285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.515285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.516656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:42:05.516656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:05.519116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:05.537960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1159/2324] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:42:05.537960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:05.540336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:05.560881 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067b52-ef29-43a2-a76f-a0619ac9bb91 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:05.566852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308b15-f47e-4f37-bfc0-a4de59650e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:05.567503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308b15-f47e-4f37-bfc0-a4de59650e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.569266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308b15-f47e-4f37-bfc0-a4de59650e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.569266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308b15-f47e-4f37-bfc0-a4de59650e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.569266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308b15-f47e-4f37-bfc0-a4de59650e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:05.570762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308b15-f47e-4f37-bfc0-a4de59650e05 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:05.583343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1160/2325] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:05.584217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308b15-f47e-4f37-bfc0-a4de59650e05 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:05.598747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308b15-f47e-4f37-bfc0-a4de59650e05 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:05.605388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:05.606336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.606715 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.607083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.607826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:05.609871 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:05.729714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd76c677f5f4ca5a61a3da7ed96e32a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.730480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd76c677f5f4ca5a61a3da7ed96e32a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.738636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd76c677f5f4ca5a61a3da7ed96e32a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.751033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd76c677f5f4ca5a61a3da7ed96e32a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.751763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd76c677f5f4ca5a61a3da7ed96e32a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:05.778472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1161/2326] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:42:05 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:42:05.778472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:05.779739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:05.839919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1166/2327] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:42:05 2022] DELETE /identity/v3/users/0fd76c677f5f4ca5a61a3da7ed96e32a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:42:05.841385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:05.843799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:05.856135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aee39b-baf9-4577-a35d-d3eaab95f328 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:05.950830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad8c0a-b06b-4280-bdd5-d00525630cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:05.953073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad8c0a-b06b-4280-bdd5-d00525630cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.953520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad8c0a-b06b-4280-bdd5-d00525630cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.954046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad8c0a-b06b-4280-bdd5-d00525630cee admin admin] PATH_INFO: `/v3/projects/f3f4ab9498554124aebfbe337ef4a033/users/4fb23c33fc30490598421e2526cc4ac8/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.959814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf4f0-63aa-48e4-8569-d5b32c2da717 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:05.966441 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba32dd-7b90-4357-bbb6-51219fb9203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:05.967083 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba32dd-7b90-4357-bbb6-51219fb9203a admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:05.967358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba32dd-7b90-4357-bbb6-51219fb9203a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:05.967866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba32dd-7b90-4357-bbb6-51219fb9203a admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:05.968672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba32dd-7b90-4357-bbb6-51219fb9203a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:05.971945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba32dd-7b90-4357-bbb6-51219fb9203a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:05.980461 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad8c0a-b06b-4280-bdd5-d00525630cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f4ab9498554124aebfbe337ef4a033, user_id=4fb23c33fc30490598421e2526cc4ac8, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:05.984720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad8c0a-b06b-4280-bdd5-d00525630cee admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:06.090911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1162/2328] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:42:05 2022] PUT /identity/v3/projects/f3f4ab9498554124aebfbe337ef4a033/users/4fb23c33fc30490598421e2526cc4ac8/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:06.092487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a76f-62f4-4fcd-a987-46b892de73b4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.092848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a76f-62f4-4fcd-a987-46b892de73b4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.093130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a76f-62f4-4fcd-a987-46b892de73b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.107129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:06.110941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1167/2329] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:42:05 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:42:06.111937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba32dd-7b90-4357-bbb6-51219fb9203a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:06.124325 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c004a76f-62f4-4fcd-a987-46b892de73b4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:06.127627 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c004a76f-62f4-4fcd-a987-46b892de73b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:06.133405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba32dd-7b90-4357-bbb6-51219fb9203a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:06.234391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757e32-4310-4de9-8c40-4617a9a0f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:06.235525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757e32-4310-4de9-8c40-4617a9a0f546 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.236499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757e32-4310-4de9-8c40-4617a9a0f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.236754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757e32-4310-4de9-8c40-4617a9a0f546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.237462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20757e32-4310-4de9-8c40-4617a9a0f546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:06.240349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20757e32-4310-4de9-8c40-4617a9a0f546 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:06.256875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1168/2330] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:06.258065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757e32-4310-4de9-8c40-4617a9a0f546 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:06.266285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1163/2331] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:06.266285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004a76f-62f4-4fcd-a987-46b892de73b4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:06.274592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757e32-4310-4de9-8c40-4617a9a0f546 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:06.278207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004a76f-62f4-4fcd-a987-46b892de73b4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:06.281296 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:06.283952 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.284488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.285211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.286445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:06.295031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3017bf-6f93-4794-a921-65ff3a534157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:06.295153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:06.295262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3017bf-6f93-4794-a921-65ff3a534157 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.295262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3017bf-6f93-4794-a921-65ff3a534157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.295262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3017bf-6f93-4794-a921-65ff3a534157 admin admin] PATH_INFO: `/v3/projects/f3f4ab9498554124aebfbe337ef4a033/users/4fb23c33fc30490598421e2526cc4ac8/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.295262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3017bf-6f93-4794-a921-65ff3a534157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f4ab9498554124aebfbe337ef4a033, user_id=4fb23c33fc30490598421e2526cc4ac8, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:06.302041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1169/2332] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:06.303346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:06.305344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:06.307612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3017bf-6f93-4794-a921-65ff3a534157 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:06.325300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1164/2333] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:42:06 2022] PUT /identity/v3/projects/f3f4ab9498554124aebfbe337ef4a033/users/4fb23c33fc30490598421e2526cc4ac8/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:06.326194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3017bf-6f93-4794-a921-65ff3a534157 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:06.412557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7a6ad-18d1-44bc-986e-9d23053ec6a7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:06.429678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3017bf-6f93-4794-a921-65ff3a534157 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:06.435099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649bb4b-82d3-4c35-89eb-e472142f3bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:06.436011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649bb4b-82d3-4c35-89eb-e472142f3bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.436324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649bb4b-82d3-4c35-89eb-e472142f3bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.436960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649bb4b-82d3-4c35-89eb-e472142f3bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.437653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649bb4b-82d3-4c35-89eb-e472142f3bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:06.440302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649bb4b-82d3-4c35-89eb-e472142f3bbe admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:06.454985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1165/2334] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:06.459601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649bb4b-82d3-4c35-89eb-e472142f3bbe admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:06.471040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649bb4b-82d3-4c35-89eb-e472142f3bbe admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:06.472657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0314007-f1dc-441f-b026-d0a571eac14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:06.473355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314007-f1dc-441f-b026-d0a571eac14c service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.473737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314007-f1dc-441f-b026-d0a571eac14c service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.474137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0314007-f1dc-441f-b026-d0a571eac14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.490901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1db869-6515-4de7-b918-1ce0ea30b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:06.491949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1db869-6515-4de7-b918-1ce0ea30b93b admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.492320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1db869-6515-4de7-b918-1ce0ea30b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.492673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1db869-6515-4de7-b918-1ce0ea30b93b admin admin] PATH_INFO: `/v3/projects/352da357a0624908a914d898e148c534/users/414e3fa01b5a46b2b3f34934fce8418a/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.494584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0314007-f1dc-441f-b026-d0a571eac14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:06.496486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0314007-f1dc-441f-b026-d0a571eac14c service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:06.512588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1170/2335] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:06.527507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1db869-6515-4de7-b918-1ce0ea30b93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=352da357a0624908a914d898e148c534, user_id=414e3fa01b5a46b2b3f34934fce8418a, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:06.530383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1db869-6515-4de7-b918-1ce0ea30b93b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:06.677094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1166/2336] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:42:06 2022] PUT /identity/v3/projects/352da357a0624908a914d898e148c534/users/414e3fa01b5a46b2b3f34934fce8418a/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:42:06.683489 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d53679-d0c7-436d-969f-40d1ebba3fb7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.683779 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d53679-d0c7-436d-969f-40d1ebba3fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.684060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d53679-d0c7-436d-969f-40d1ebba3fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.728926 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-80d53679-d0c7-436d-969f-40d1ebba3fb7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:06.733448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-80d53679-d0c7-436d-969f-40d1ebba3fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:06.822601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1171/2337] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:06.840458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1db869-6515-4de7-b918-1ce0ea30b93b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:06.946818 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1db869-6515-4de7-b918-1ce0ea30b93b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:06.952305 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681970f8-c4e0-4fdc-ad44-cf5e858fae3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:06.953128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681970f8-c4e0-4fdc-ad44-cf5e858fae3a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:06.953409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681970f8-c4e0-4fdc-ad44-cf5e858fae3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:06.953679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681970f8-c4e0-4fdc-ad44-cf5e858fae3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:06.965539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681970f8-c4e0-4fdc-ad44-cf5e858fae3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:06.967179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681970f8-c4e0-4fdc-ad44-cf5e858fae3a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:06.980788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1167/2338] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:07.213764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d53679-d0c7-436d-969f-40d1ebba3fb7 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:07.215355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-80d53679-d0c7-436d-969f-40d1ebba3fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:07.230077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d53679-d0c7-436d-969f-40d1ebba3fb7 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:07.249254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:07.249925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:07.250231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:07.250507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] PATH_INFO: `/v3/projects/ee050cc33ed54b6d999fef78b8a3b439` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:07.256673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee050cc33ed54b6d999fef78b8a3b439)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:07.258552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:07.419570 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee050cc33ed54b6d999fef78b8a3b439', 'request_id': 'req-44897249-4756-4bff-8670-032174feb5dd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:07.534197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee050cc33ed54b6d999fef78b8a3b439', 'request_id': 'req-44897249-4756-4bff-8670-032174feb5dd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:07.552185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee050cc33ed54b6d999fef78b8a3b439', 'request_id': 'req-44897249-4756-4bff-8670-032174feb5dd'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:07.564777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] The token cache is being invalidate because project ee050cc33ed54b6d999fef78b8a3b439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:42:07.565467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:07.566298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-44897249-4756-4bff-8670-032174feb5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:07.568591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1172/2339] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:42:07 2022] DELETE /identity/v3/projects/ee050cc33ed54b6d999fef78b8a3b439 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:07.573814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1c80b-79d4-4e6d-ba90-afa47be15b70 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:07.574131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1c80b-79d4-4e6d-ba90-afa47be15b70 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:07.576909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1c80b-79d4-4e6d-ba90-afa47be15b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:07.610792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-24f1c80b-79d4-4e6d-ba90-afa47be15b70 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:07.612266 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-24f1c80b-79d4-4e6d-ba90-afa47be15b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:07.732469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1168/2340] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:07.746762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb851-271c-42ee-ad70-bc271f7b0464 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:07.747284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb851-271c-42ee-ad70-bc271f7b0464 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:07.747808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb851-271c-42ee-ad70-bc271f7b0464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:07.801406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-657eb851-271c-42ee-ad70-bc271f7b0464 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:07.802679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-657eb851-271c-42ee-ad70-bc271f7b0464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:07.836216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1173/2341] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:07.840571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1c80b-79d4-4e6d-ba90-afa47be15b70 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:07.863997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1c80b-79d4-4e6d-ba90-afa47be15b70 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:07.884856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:07.884856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:07.884856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:07.884856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:07.885566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:42:07.885566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:07.885566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:07.926994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1169/2342] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:42:07.933095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eb851-271c-42ee-ad70-bc271f7b0464 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:07.945649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eb851-271c-42ee-ad70-bc271f7b0464 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:07.965564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f232e0-b1e5-4d3f-8db8-23ab91c7961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:07.966375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f232e0-b1e5-4d3f-8db8-23ab91c7961f admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:07.966843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f232e0-b1e5-4d3f-8db8-23ab91c7961f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:07.967273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f232e0-b1e5-4d3f-8db8-23ab91c7961f admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:07.968084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f232e0-b1e5-4d3f-8db8-23ab91c7961f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:07.972115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f232e0-b1e5-4d3f-8db8-23ab91c7961f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:08.202124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1174/2343] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:42:07 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:42:08.205300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:08.237964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba1409-ca4f-4d99-81fc-1a36e3f2c9ec admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:08.384196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea2d55-389d-4f0a-ba07-86affd6be824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:08.384827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea2d55-389d-4f0a-ba07-86affd6be824 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:08.385172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea2d55-389d-4f0a-ba07-86affd6be824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:08.385454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea2d55-389d-4f0a-ba07-86affd6be824 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:08.386170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea2d55-389d-4f0a-ba07-86affd6be824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:08.388140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea2d55-389d-4f0a-ba07-86affd6be824 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:08.950352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1170/2344] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:42:08 2022] POST /identity/v3/users => generated 283 bytes in 746 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:42:08.954961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f232e0-b1e5-4d3f-8db8-23ab91c7961f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:08.965423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f232e0-b1e5-4d3f-8db8-23ab91c7961f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:08.970573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41323574-ec3b-465a-bfb9-52d679fdb925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:08.971694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41323574-ec3b-465a-bfb9-52d679fdb925 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:08.971694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41323574-ec3b-465a-bfb9-52d679fdb925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:08.971694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41323574-ec3b-465a-bfb9-52d679fdb925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:08.972315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41323574-ec3b-465a-bfb9-52d679fdb925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:08.973897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41323574-ec3b-465a-bfb9-52d679fdb925 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:09.002140 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1175/2345] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:09.002466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea2d55-389d-4f0a-ba07-86affd6be824 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:09.020815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea2d55-389d-4f0a-ba07-86affd6be824 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:09.027319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a6d1a-55ba-499f-bd86-db23c7b4e3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:09.034880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a6d1a-55ba-499f-bd86-db23c7b4e3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:09.034880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a6d1a-55ba-499f-bd86-db23c7b4e3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:09.034880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a6d1a-55ba-499f-bd86-db23c7b4e3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:09.034880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a6d1a-55ba-499f-bd86-db23c7b4e3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:09.034880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a6d1a-55ba-499f-bd86-db23c7b4e3cf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:09.050252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1171/2346] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:09.053376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:09.054907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41323574-ec3b-465a-bfb9-52d679fdb925 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:09.069197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41323574-ec3b-465a-bfb9-52d679fdb925 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:09.086497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:09.087187 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:09.087471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:09.088090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] PATH_INFO: `/v3/projects/687bd82e22fd49938ac9df953706f142/users/d7d58e8c01ca4da1b9a5456d54f36fbd/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:09.118416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] RBAC: Authorizing `identity:create_grant(project_id=687bd82e22fd49938ac9df953706f142, user_id=d7d58e8c01ca4da1b9a5456d54f36fbd, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:09.121254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:09.304285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1176/2347] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:42:09 2022] PUT /identity/v3/projects/687bd82e22fd49938ac9df953706f142/users/d7d58e8c01ca4da1b9a5456d54f36fbd/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:09.316490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da632d6-6b3f-489f-8d8d-38c111c5ce7f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:09.317061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da632d6-6b3f-489f-8d8d-38c111c5ce7f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:09.317061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da632d6-6b3f-489f-8d8d-38c111c5ce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:09.352904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8da632d6-6b3f-489f-8d8d-38c111c5ce7f None None] MFA Rules not processed for user `d7d58e8c01ca4da1b9a5456d54f36fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:09.354355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8da632d6-6b3f-489f-8d8d-38c111c5ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:09.508388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1172/2348] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:09.527433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:09.530476 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:09.616859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ae719-4b0e-401f-ba40-5b0a9746308f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:09.621652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:09.622725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:09.624437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:09.625069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:09.638323 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:09.640807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:09.665621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1177/2349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:11.135562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:11.600230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:14.526306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:14.939713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:16.679661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52156d4-27e1-48f8-8324-afe96b3e4931 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:16.680700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52156d4-27e1-48f8-8324-afe96b3e4931 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:16.681176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52156d4-27e1-48f8-8324-afe96b3e4931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:16.733693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c52156d4-27e1-48f8-8324-afe96b3e4931 None None] MFA Rules not processed for user `414e3fa01b5a46b2b3f34934fce8418a`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:16.735460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c52156d4-27e1-48f8-8324-afe96b3e4931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:16.863561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1173/2350] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:16.867899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:16.869362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:16.978759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2616b-9880-425c-8ba9-914eeefca21d service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:16.987864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ee69-9ae1-40e7-9e5b-4cd4563efab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:16.988907 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ee69-9ae1-40e7-9e5b-4cd4563efab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:16.989438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ee69-9ae1-40e7-9e5b-4cd4563efab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:16.990102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933ee69-9ae1-40e7-9e5b-4cd4563efab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:16.991975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ee69-9ae1-40e7-9e5b-4cd4563efab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:16.994977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933ee69-9ae1-40e7-9e5b-4cd4563efab8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:17.101222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1685-b807-4fd4-b8c8-027bb1c54d00 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:17.101545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1685-b807-4fd4-b8c8-027bb1c54d00 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:17.103012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1685-b807-4fd4-b8c8-027bb1c54d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:17.113413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1178/2351] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:42:16 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:42:17.118043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ee69-9ae1-40e7-9e5b-4cd4563efab8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:17.185922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8cfc1685-b807-4fd4-b8c8-027bb1c54d00 None None] MFA Rules not processed for user `4fb23c33fc30490598421e2526cc4ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:17.187254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8cfc1685-b807-4fd4-b8c8-027bb1c54d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:17.244626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933ee69-9ae1-40e7-9e5b-4cd4563efab8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:17.257625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af640-2abf-45d1-9dcb-b5466b0f9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:17.258819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af640-2abf-45d1-9dcb-b5466b0f9b50 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:17.259296 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af640-2abf-45d1-9dcb-b5466b0f9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:17.259796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1af640-2abf-45d1-9dcb-b5466b0f9b50 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:17.260674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af640-2abf-45d1-9dcb-b5466b0f9b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:17.262766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1af640-2abf-45d1-9dcb-b5466b0f9b50 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:17.318263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1174/2352] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:17.333156 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1685-b807-4fd4-b8c8-027bb1c54d00 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:17.336446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8cfc1685-b807-4fd4-b8c8-027bb1c54d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:17.416035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1179/2353] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:42:17 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:42:17.418846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af640-2abf-45d1-9dcb-b5466b0f9b50 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:17.435885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1af640-2abf-45d1-9dcb-b5466b0f9b50 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:17.441956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1685-b807-4fd4-b8c8-027bb1c54d00 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:17.445369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee61f17-6907-4c8d-85b6-d0b53420f274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:17.446277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61f17-6907-4c8d-85b6-d0b53420f274 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:17.446482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dca3ee8b78402eb95815eb200d90a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:17.446626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61f17-6907-4c8d-85b6-d0b53420f274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:17.446831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61f17-6907-4c8d-85b6-d0b53420f274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:17.447093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:17.447426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:17.447539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee61f17-6907-4c8d-85b6-d0b53420f274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:17.447700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:17.449109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee61f17-6907-4c8d-85b6-d0b53420f274 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:17.449551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:17.468648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1180/2354] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:17.473469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee61f17-6907-4c8d-85b6-d0b53420f274 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:17.486158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee61f17-6907-4c8d-85b6-d0b53420f274 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:17.491753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc94e5-4510-4b34-83b0-01046cc1d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:17.492498 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc94e5-4510-4b34-83b0-01046cc1d122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:17.492782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc94e5-4510-4b34-83b0-01046cc1d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:17.493063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc94e5-4510-4b34-83b0-01046cc1d122 admin admin] PATH_INFO: `/v3/projects/23dac7b4c3a540d7ac1b52e2448d71f7/users/431544c260f9452aa494b35f2d090b75/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:17.523680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc94e5-4510-4b34-83b0-01046cc1d122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dac7b4c3a540d7ac1b52e2448d71f7, user_id=431544c260f9452aa494b35f2d090b75, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:17.526681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc94e5-4510-4b34-83b0-01046cc1d122 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:17.550678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:17.552138 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:17.562731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1175/2355] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:17.629429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:17.657452 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1181/2356] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:42:17 2022] PUT /identity/v3/projects/23dac7b4c3a540d7ac1b52e2448d71f7/users/431544c260f9452aa494b35f2d090b75/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:42:17.661570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:17.674406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52ab37-5d98-4d6f-9278-6c051de52089 service glance] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:17.771317 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e65fad-9e63-48e6-889a-b2235162d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:17.772026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e65fad-9e63-48e6-889a-b2235162d377 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:17.772298 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e65fad-9e63-48e6-889a-b2235162d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:17.772576 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e65fad-9e63-48e6-889a-b2235162d377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:17.773221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e65fad-9e63-48e6-889a-b2235162d377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:17.774886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e65fad-9e63-48e6-889a-b2235162d377 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:17.786016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1176/2357] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:17.791391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc94e5-4510-4b34-83b0-01046cc1d122 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:17.804283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc94e5-4510-4b34-83b0-01046cc1d122 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:17.809233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:17.809904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:17.810230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:17.810507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] PATH_INFO: `/v3/projects/23dac7b4c3a540d7ac1b52e2448d71f7/users/431544c260f9452aa494b35f2d090b75/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:17.812465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dac7b4c3a540d7ac1b52e2448d71f7, user_id=431544c260f9452aa494b35f2d090b75, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:17.815190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:17.828536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1182/2358] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:42:17 2022] PUT /identity/v3/projects/23dac7b4c3a540d7ac1b52e2448d71f7/users/431544c260f9452aa494b35f2d090b75/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:17.965580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cef876-b657-4919-9cd8-fa15d8c97612 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:17.966017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cef876-b657-4919-9cd8-fa15d8c97612 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:17.966426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cef876-b657-4919-9cd8-fa15d8c97612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:17.991068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-22cef876-b657-4919-9cd8-fa15d8c97612 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:17.992723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-22cef876-b657-4919-9cd8-fa15d8c97612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:18.075146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1177/2359] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:42:18.082189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:18.084099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:18.108529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:18.173199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fa97b-ece6-4c9a-8d16-bc0599403f78 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:18.178724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3eca0d-25f1-45c9-a19c-d228e2bf41a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:18.179340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eca0d-25f1-45c9-a19c-d228e2bf41a5 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:18.179607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eca0d-25f1-45c9-a19c-d228e2bf41a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:18.179881 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eca0d-25f1-45c9-a19c-d228e2bf41a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:18.190641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3eca0d-25f1-45c9-a19c-d228e2bf41a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:18.194450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3eca0d-25f1-45c9-a19c-d228e2bf41a5 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:18.201997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1183/2360] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:42:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:42:20.636846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:21.204568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:22.350353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:23.550319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:23.622686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320635-ada5-4fb5-a76f-ef3e0f821cf3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:23.623146 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320635-ada5-4fb5-a76f-ef3e0f821cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:23.623656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70320635-ada5-4fb5-a76f-ef3e0f821cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:23.693442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-70320635-ada5-4fb5-a76f-ef3e0f821cf3 None None] MFA Rules not processed for user `f818e4ca845c474081b7c49994ee3737`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:23.703523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-70320635-ada5-4fb5-a76f-ef3e0f821cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:23.915983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1178/2361] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:24.824213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:27.009209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:28.132565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:28.594488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:29.628730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59a0a-c916-431d-8026-8907c048bb7c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:29.629270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59a0a-c916-431d-8026-8907c048bb7c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:29.629812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59a0a-c916-431d-8026-8907c048bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:29.752506 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-07c59a0a-c916-431d-8026-8907c048bb7c None None] MFA Rules not processed for user `431544c260f9452aa494b35f2d090b75`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:29.756202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-07c59a0a-c916-431d-8026-8907c048bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:29.880201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1184/2362] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:29.894115 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70320635-ada5-4fb5-a76f-ef3e0f821cf3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:29.897021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-70320635-ada5-4fb5-a76f-ef3e0f821cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:30.121383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70320635-ada5-4fb5-a76f-ef3e0f821cf3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:30.129055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d402eb3-f00c-4685-8a26-cecaea521181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:30.129595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d402eb3-f00c-4685-8a26-cecaea521181 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:30.129877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d402eb3-f00c-4685-8a26-cecaea521181 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:30.130245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d402eb3-f00c-4685-8a26-cecaea521181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:30.201400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d402eb3-f00c-4685-8a26-cecaea521181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:30.203079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d402eb3-f00c-4685-8a26-cecaea521181 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:30.215732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1179/2363] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:30.862683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:31.051499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:32.154756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:34.657844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:35.026591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:35.133124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503eda-21c9-4f75-8bcf-462bff89b224 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:35.133422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503eda-21c9-4f75-8bcf-462bff89b224 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:35.133685 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503eda-21c9-4f75-8bcf-462bff89b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:35.161190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-84503eda-21c9-4f75-8bcf-462bff89b224 None None] MFA Rules not processed for user `414e3fa01b5a46b2b3f34934fce8418a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:35.162728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-84503eda-21c9-4f75-8bcf-462bff89b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:35.170678 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1185/2364] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:35.917049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136605-9151-431c-8023-1a0299280a1c None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:35.917923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136605-9151-431c-8023-1a0299280a1c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:35.918674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31136605-9151-431c-8023-1a0299280a1c None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:35.919940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1180/2365] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:42:35.998688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f347ba-d3e8-4025-aff0-c55db997e2b1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:35.999338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f347ba-d3e8-4025-aff0-c55db997e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:36.000478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f347ba-d3e8-4025-aff0-c55db997e2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:36.020882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:36.036752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d5f347ba-d3e8-4025-aff0-c55db997e2b1 None None] MFA Rules not processed for user `47cdb10124184914a81a87ae3173b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:36.038723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d5f347ba-d3e8-4025-aff0-c55db997e2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:36.115611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31136605-9151-431c-8023-1a0299280a1c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:36.117471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-31136605-9151-431c-8023-1a0299280a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:36.162445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1186/2366] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:36.174362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f347ba-d3e8-4025-aff0-c55db997e2b1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:36.176362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d5f347ba-d3e8-4025-aff0-c55db997e2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:36.198248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f347ba-d3e8-4025-aff0-c55db997e2b1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:36.206531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b649-f0fb-4e01-be57-2c3776d624cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:36.206531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b649-f0fb-4e01-be57-2c3776d624cc service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:36.206531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b649-f0fb-4e01-be57-2c3776d624cc service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:36.206531 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b649-f0fb-4e01-be57-2c3776d624cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:36.216708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69b649-f0fb-4e01-be57-2c3776d624cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:36.219176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69b649-f0fb-4e01-be57-2c3776d624cc service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:36.235721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1187/2367] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:36.283273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31136605-9151-431c-8023-1a0299280a1c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:36.296233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:36.297782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:36.298459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:36.298745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] PATH_INFO: `/v3/users/e21742c06a4247078e56958e53747c6a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:36.300144 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21742c06a4247078e56958e53747c6a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:36.302375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:36.590188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21742c06a4247078e56958e53747c6a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:36.604882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21742c06a4247078e56958e53747c6a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:36.709701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21742c06a4247078e56958e53747c6a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:36.715551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21742c06a4247078e56958e53747c6a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:36.719402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21742c06a4247078e56958e53747c6a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:36.725945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1181/2368] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:42:36 2022] DELETE /identity/v3/users/e21742c06a4247078e56958e53747c6a => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:42:37.139047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b649-f0fb-4e01-be57-2c3776d624cc service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:37.157246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b649-f0fb-4e01-be57-2c3776d624cc service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:37.251182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:37.251898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:37.252243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:37.252585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] PATH_INFO: `/v3/projects/132c7679cb964fd78c933506c791dd4a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:37.253784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132c7679cb964fd78c933506c791dd4a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:37.255943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:37.382227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132c7679cb964fd78c933506c791dd4a', 'request_id': 'req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:37.439400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:37.473090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132c7679cb964fd78c933506c791dd4a', 'request_id': 'req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:37.480786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132c7679cb964fd78c933506c791dd4a', 'request_id': 'req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:37.493141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] The token cache is being invalidate because project 132c7679cb964fd78c933506c791dd4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:42:37.493661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:37.494565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:37.496679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1188/2369] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:42:37 2022] DELETE /identity/v3/projects/132c7679cb964fd78c933506c791dd4a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:37.502268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:37.513458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:37.529641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f97a3b-0f48-454e-b8aa-f370f90c1dab admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:37.620788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:37.621785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:37.622098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:37.622551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] PATH_INFO: `/v3/users/b2d1e0f4ad704ad3a1a7221860a2cc91` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:37.623837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d1e0f4ad704ad3a1a7221860a2cc91)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:37.626423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:38.346660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d1e0f4ad704ad3a1a7221860a2cc91'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:38.360569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d1e0f4ad704ad3a1a7221860a2cc91'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:38.475272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d1e0f4ad704ad3a1a7221860a2cc91'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:38.475899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d1e0f4ad704ad3a1a7221860a2cc91'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:38.487972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a7c047c-d3d8-4576-b886-16ff861b4df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d1e0f4ad704ad3a1a7221860a2cc91'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:38.495568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1182/2370] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:42:37 2022] DELETE /identity/v3/users/b2d1e0f4ad704ad3a1a7221860a2cc91 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:42:38.812945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:38.858444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:38.861166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:38.873908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e0d9a-7306-45ef-9186-81e0dfdb9a17 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:38.945684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:38.946415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:38.946695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:38.946964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] PATH_INFO: `/v3/projects/6b3888cb7e5741afa653fb512be2130e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:38.948107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3888cb7e5741afa653fb512be2130e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:38.950058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:39.126170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3888cb7e5741afa653fb512be2130e', 'request_id': 'req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:39.248455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3888cb7e5741afa653fb512be2130e', 'request_id': 'req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:39.256230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3888cb7e5741afa653fb512be2130e', 'request_id': 'req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:39.267883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] The token cache is being invalidate because project 6b3888cb7e5741afa653fb512be2130e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:42:39.268065 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:39.268614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0c2ec09c-dffe-4a3b-9651-7ddbe77a5d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:39.270162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1189/2371] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:42:38 2022] DELETE /identity/v3/projects/6b3888cb7e5741afa653fb512be2130e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:39.274963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534cdf6-0fa0-4575-8b7b-506f30bd5da3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:39.275319 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534cdf6-0fa0-4575-8b7b-506f30bd5da3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:39.275685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534cdf6-0fa0-4575-8b7b-506f30bd5da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:39.296773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b534cdf6-0fa0-4575-8b7b-506f30bd5da3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:39.298136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b534cdf6-0fa0-4575-8b7b-506f30bd5da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:39.371462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1183/2372] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:39.373538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baa73a-54c9-407d-85bc-8ccf0a21c717 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:39.373538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baa73a-54c9-407d-85bc-8ccf0a21c717 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:39.373740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baa73a-54c9-407d-85bc-8ccf0a21c717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:39.405048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-07baa73a-54c9-407d-85bc-8ccf0a21c717 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:39.407268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-07baa73a-54c9-407d-85bc-8ccf0a21c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:39.416151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1190/2373] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:39.420608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534cdf6-0fa0-4575-8b7b-506f30bd5da3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:39.430717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534cdf6-0fa0-4575-8b7b-506f30bd5da3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:39.435907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea2f9c-29d3-413c-88a1-73b86e5b3d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:39.436517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2f9c-29d3-413c-88a1-73b86e5b3d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:39.436799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2f9c-29d3-413c-88a1-73b86e5b3d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:39.437074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2f9c-29d3-413c-88a1-73b86e5b3d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:39.437931 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2f9c-29d3-413c-88a1-73b86e5b3d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:42:39.438247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2f9c-29d3-413c-88a1-73b86e5b3d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:39.439983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2f9c-29d3-413c-88a1-73b86e5b3d10 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:39.455828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1184/2374] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:42:39.457875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baa73a-54c9-407d-85bc-8ccf0a21c717 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:39.469499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baa73a-54c9-407d-85bc-8ccf0a21c717 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:39.474543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14600-507e-4efa-824d-4aee34ccfa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:39.475147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14600-507e-4efa-824d-4aee34ccfa8e admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:39.475427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14600-507e-4efa-824d-4aee34ccfa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:39.475701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14600-507e-4efa-824d-4aee34ccfa8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:39.476331 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c14600-507e-4efa-824d-4aee34ccfa8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:39.478344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c14600-507e-4efa-824d-4aee34ccfa8e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:39.555051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a864d-e36c-4091-9668-6407dee7374a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:39.555357 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a864d-e36c-4091-9668-6407dee7374a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:39.555639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a864d-e36c-4091-9668-6407dee7374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:39.582672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8c1a864d-e36c-4091-9668-6407dee7374a None None] MFA Rules not processed for user `12b6287f37d9429e873d1ac7dcebe42c`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:39.584065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8c1a864d-e36c-4091-9668-6407dee7374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:39.636720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1191/2375] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:42:39 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:42:39.644809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14600-507e-4efa-824d-4aee34ccfa8e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:39.677180 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1185/2376] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:42:39.754504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14600-507e-4efa-824d-4aee34ccfa8e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:39.761163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4a97-e09a-42d1-a5ff-41d66874641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:39.761787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4a97-e09a-42d1-a5ff-41d66874641f admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:39.762119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4a97-e09a-42d1-a5ff-41d66874641f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:39.762396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4a97-e09a-42d1-a5ff-41d66874641f admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:39.763032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb4a97-e09a-42d1-a5ff-41d66874641f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:39.767105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb4a97-e09a-42d1-a5ff-41d66874641f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:39.878723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1192/2377] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:42:39 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:42:39.883277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a864d-e36c-4091-9668-6407dee7374a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:39.913522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a864d-e36c-4091-9668-6407dee7374a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:39.923998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ba421-d499-426b-9050-218a1ea54341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:39.924827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ba421-d499-426b-9050-218a1ea54341 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:39.925205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ba421-d499-426b-9050-218a1ea54341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:39.925574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ba421-d499-426b-9050-218a1ea54341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:39.926810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ba421-d499-426b-9050-218a1ea54341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:39.929743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ba421-d499-426b-9050-218a1ea54341 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:39.944347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1186/2378] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:39.948467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4a97-e09a-42d1-a5ff-41d66874641f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:39.962930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4a97-e09a-42d1-a5ff-41d66874641f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:39.969910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7f96f-d00f-4fc5-b83a-3ebead4f4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:39.970793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f96f-d00f-4fc5-b83a-3ebead4f4a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:39.971268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f96f-d00f-4fc5-b83a-3ebead4f4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:39.971821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7f96f-d00f-4fc5-b83a-3ebead4f4a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:39.973127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7f96f-d00f-4fc5-b83a-3ebead4f4a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:39.975304 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7f96f-d00f-4fc5-b83a-3ebead4f4a3d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:40.008655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1193/2379] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:42:40.010012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ba421-d499-426b-9050-218a1ea54341 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:40.023143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ba421-d499-426b-9050-218a1ea54341 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:40.033423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:40.034540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:40.034835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:40.035267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] PATH_INFO: `/v3/projects/f66f2853dd104983a0c9541655aa67d5/users/46b51920455544a09471e01460871ae5/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:40.052034 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66f2853dd104983a0c9541655aa67d5, user_id=46b51920455544a09471e01460871ae5, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:40.054819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:40.177361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:40.184402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1187/2380] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:42:40 2022] PUT /identity/v3/projects/f66f2853dd104983a0c9541655aa67d5/users/46b51920455544a09471e01460871ae5/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:40.193604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb7ef-b7d6-43c0-8adf-ad5e84dde3d5 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:40.193897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb7ef-b7d6-43c0-8adf-ad5e84dde3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:40.194213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fb7ef-b7d6-43c0-8adf-ad5e84dde3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:40.227798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8b3fb7ef-b7d6-43c0-8adf-ad5e84dde3d5 None None] MFA Rules not processed for user `46b51920455544a09471e01460871ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:40.229060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8b3fb7ef-b7d6-43c0-8adf-ad5e84dde3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:40.317839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1194/2381] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:40.330710 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:40.332456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:40.405531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa47ae4-f751-4cc0-be11-47f3fd684d54 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:40.412604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fb452-1369-4a3f-95fc-8012c01594e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:40.413485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb452-1369-4a3f-95fc-8012c01594e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:40.419597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb452-1369-4a3f-95fc-8012c01594e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:40.419597 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb452-1369-4a3f-95fc-8012c01594e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:40.425264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb452-1369-4a3f-95fc-8012c01594e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:40.427002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb452-1369-4a3f-95fc-8012c01594e5 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:40.437046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1188/2382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:40.464826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fb7ef-b7d6-43c0-8adf-ad5e84dde3d5 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:40.551326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fb7ef-b7d6-43c0-8adf-ad5e84dde3d5 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:40.558284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:40.559144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:40.559626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:40.559970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] PATH_INFO: `/v3/users/46b51920455544a09471e01460871ae5` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:40.561608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b51920455544a09471e01460871ae5)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:40.565017 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:40.775896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b51920455544a09471e01460871ae5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:40.776578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b51920455544a09471e01460871ae5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:40.784386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b51920455544a09471e01460871ae5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:40.797772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b51920455544a09471e01460871ae5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:40.798577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b51920455544a09471e01460871ae5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:40.903978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1195/2383] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:42:40 2022] DELETE /identity/v3/users/46b51920455544a09471e01460871ae5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:42:40.915519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfec89-20af-432c-b3e3-799749f73eea None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:40.916041 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfec89-20af-432c-b3e3-799749f73eea None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:40.916136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfec89-20af-432c-b3e3-799749f73eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:40.936221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-31cfec89-20af-432c-b3e3-799749f73eea None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:40.937652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-31cfec89-20af-432c-b3e3-799749f73eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:40.976893 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:41.019895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1189/2384] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:41.029634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:41.031324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:41.100395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967d40-d875-44d5-89b5-7b0968cb9e93 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:41.104326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a2cef-7f79-44ac-88be-cc27d0e7c5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:41.104962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2cef-7f79-44ac-88be-cc27d0e7c5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:41.105278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2cef-7f79-44ac-88be-cc27d0e7c5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:41.105507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a2cef-7f79-44ac-88be-cc27d0e7c5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:41.118731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a2cef-7f79-44ac-88be-cc27d0e7c5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:41.120202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a2cef-7f79-44ac-88be-cc27d0e7c5c8 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:41.131722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1196/2385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:42:41.595066 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfec89-20af-432c-b3e3-799749f73eea None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:41.598843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-31cfec89-20af-432c-b3e3-799749f73eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:41.623777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfec89-20af-432c-b3e3-799749f73eea None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:41.636531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:41.637248 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:41.637817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:41.638301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] PATH_INFO: `/v3/projects/f66f2853dd104983a0c9541655aa67d5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:41.648327 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66f2853dd104983a0c9541655aa67d5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:41.650555 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:41.828687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66f2853dd104983a0c9541655aa67d5', 'request_id': 'req-e561285c-7103-4a87-aef5-9f1001ca30e7'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:41.915994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66f2853dd104983a0c9541655aa67d5', 'request_id': 'req-e561285c-7103-4a87-aef5-9f1001ca30e7'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:41.924297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66f2853dd104983a0c9541655aa67d5', 'request_id': 'req-e561285c-7103-4a87-aef5-9f1001ca30e7'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:41.940894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] The token cache is being invalidate because project f66f2853dd104983a0c9541655aa67d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:42:41.941299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:41.942344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:42:41.944242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1190/2386] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:42:41 2022] DELETE /identity/v3/projects/f66f2853dd104983a0c9541655aa67d5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:42:42.240879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:43.456506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:43.795519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:45.046311 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d067-a231-4159-a3c0-dc7cef9e623e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:45.046965 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d067-a231-4159-a3c0-dc7cef9e623e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:45.047137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d067-a231-4159-a3c0-dc7cef9e623e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:45.071234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b843d067-a231-4159-a3c0-dc7cef9e623e None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:42:45.075210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b843d067-a231-4159-a3c0-dc7cef9e623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:45.175298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1197/2387] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:42:45.191569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:42:45.194438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:42:45.221961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:45.327023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561285c-7103-4a87-aef5-9f1001ca30e7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:42:45.327023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee9296-ab27-405b-b4fe-f28195f93659 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:42:45.327023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9296-ab27-405b-b4fe-f28195f93659 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:42:45.327023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9296-ab27-405b-b4fe-f28195f93659 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:42:45.327379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee9296-ab27-405b-b4fe-f28195f93659 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:42:45.338976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee9296-ab27-405b-b4fe-f28195f93659 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:42:45.340731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee9296-ab27-405b-b4fe-f28195f93659 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:42:45.350616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1191/2388] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:42:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:42:45.582852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:46.719709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:46.847071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:47.326968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:47.907533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:48.321143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:48.647365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:48.720761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:49.966646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:50.067486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:50.092585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:50.395669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:50.427639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:50.732392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:50.801128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:51.039025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:51.143973 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:51.301343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:51.389682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:51.418616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:51.475823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:51.563823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:51.781947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:52.018028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:52.255545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:52.564855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:52.706257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:52.778492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:52.901548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.023845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.110484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.138478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.269297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.297604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.364329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.498198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.650639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:53.838673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.074091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.179920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.204099 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.250513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.284594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.381055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.404200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.480501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.598490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.623762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.683122 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.741201 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.764197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.861536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.893749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:54.978361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:55.068427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:55.159238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:42:55.320566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:01.695939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d067-a231-4159-a3c0-dc7cef9e623e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:01.697758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b843d067-a231-4159-a3c0-dc7cef9e623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:01.792121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d067-a231-4159-a3c0-dc7cef9e623e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:01.802449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:01.802449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:01.802449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:01.802449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:01.802859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:01.815152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:01.817103 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:01.829193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1198/2389] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:03.039839 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04ac3-b2bb-4e7e-8c5f-469dacf1f630 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:03.040301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04ac3-b2bb-4e7e-8c5f-469dacf1f630 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:03.040488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04ac3-b2bb-4e7e-8c5f-469dacf1f630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:03.072492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-94d04ac3-b2bb-4e7e-8c5f-469dacf1f630 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:03.073845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-94d04ac3-b2bb-4e7e-8c5f-469dacf1f630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:03.082222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1192/2390] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:03.103790 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:03.116117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5d0d-6b38-40b6-b7e3-8e8edbe30d39 service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:03.121046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e09542-d5d6-4ee7-93eb-9da896cf402c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:03.121644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e09542-d5d6-4ee7-93eb-9da896cf402c service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:03.121930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e09542-d5d6-4ee7-93eb-9da896cf402c service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:03.122767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e09542-d5d6-4ee7-93eb-9da896cf402c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:03.132356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e09542-d5d6-4ee7-93eb-9da896cf402c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:03.133957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e09542-d5d6-4ee7-93eb-9da896cf402c service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:03.142543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1199/2391] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:43:07.450686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04ac3-b2bb-4e7e-8c5f-469dacf1f630 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:07.456775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-94d04ac3-b2bb-4e7e-8c5f-469dacf1f630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:07.639534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04ac3-b2bb-4e7e-8c5f-469dacf1f630 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:07.644799 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:07.645682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:07.646600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:07.647216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] PATH_INFO: `/v3/users/d7d58e8c01ca4da1b9a5456d54f36fbd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:07.648850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d58e8c01ca4da1b9a5456d54f36fbd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:07.652308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:07.728010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d356c-74c6-4a36-a9e3-992cd6c713cc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:07.728524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d356c-74c6-4a36-a9e3-992cd6c713cc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:07.728609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d356c-74c6-4a36-a9e3-992cd6c713cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:07.771564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e78d356c-74c6-4a36-a9e3-992cd6c713cc None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:07.773597 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e78d356c-74c6-4a36-a9e3-992cd6c713cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:07.805502 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1200/2392] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:43:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:07.857836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d356c-74c6-4a36-a9e3-992cd6c713cc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:07.880687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d356c-74c6-4a36-a9e3-992cd6c713cc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:07.891908 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad96b9-0e15-4f73-b3d5-c02652c4047c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:07.892891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad96b9-0e15-4f73-b3d5-c02652c4047c service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:07.893342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad96b9-0e15-4f73-b3d5-c02652c4047c service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:07.893768 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad96b9-0e15-4f73-b3d5-c02652c4047c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:07.911914 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad96b9-0e15-4f73-b3d5-c02652c4047c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:07.913855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad96b9-0e15-4f73-b3d5-c02652c4047c service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:07.938752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d58e8c01ca4da1b9a5456d54f36fbd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:07.941855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1201/2393] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:43:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:43:07.971094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d58e8c01ca4da1b9a5456d54f36fbd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:08.143680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d58e8c01ca4da1b9a5456d54f36fbd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:08.144514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d58e8c01ca4da1b9a5456d54f36fbd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:08.165185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d58e8c01ca4da1b9a5456d54f36fbd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:08.192098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1193/2394] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:43:07 2022] DELETE /identity/v3/users/d7d58e8c01ca4da1b9a5456d54f36fbd => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:43:08.197809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14126-2d25-41ae-9dca-05465e594b1c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:08.198168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14126-2d25-41ae-9dca-05465e594b1c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:08.198546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14126-2d25-41ae-9dca-05465e594b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:08.255022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-dfd14126-2d25-41ae-9dca-05465e594b1c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:08.256710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dfd14126-2d25-41ae-9dca-05465e594b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:08.277936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:08.493263 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1202/2395] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:08.512773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:08.514984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:08.593072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:08.726857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c6df4-ab74-4d97-846c-93be0dc04481 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:08.738894 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2691e-9f5a-4509-bcd1-1c7638918da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:08.739548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2691e-9f5a-4509-bcd1-1c7638918da6 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:08.739827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2691e-9f5a-4509-bcd1-1c7638918da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:08.740096 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2691e-9f5a-4509-bcd1-1c7638918da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:08.761092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2691e-9f5a-4509-bcd1-1c7638918da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:08.762629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2691e-9f5a-4509-bcd1-1c7638918da6 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:08.785330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1194/2396] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:10.267270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd14126-2d25-41ae-9dca-05465e594b1c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:10.268803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dfd14126-2d25-41ae-9dca-05465e594b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:10.310636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd14126-2d25-41ae-9dca-05465e594b1c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:10.317257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:10.318771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:10.319619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:10.320053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] PATH_INFO: `/v3/projects/687bd82e22fd49938ac9df953706f142` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:10.321703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=687bd82e22fd49938ac9df953706f142)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:10.323910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:10.527935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687bd82e22fd49938ac9df953706f142', 'request_id': 'req-b986e396-d362-4699-9db5-3711763cb19c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:10.600139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687bd82e22fd49938ac9df953706f142', 'request_id': 'req-b986e396-d362-4699-9db5-3711763cb19c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:10.607892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687bd82e22fd49938ac9df953706f142', 'request_id': 'req-b986e396-d362-4699-9db5-3711763cb19c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:10.635283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] The token cache is being invalidate because project 687bd82e22fd49938ac9df953706f142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:43:10.639000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:10.643181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b986e396-d362-4699-9db5-3711763cb19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:10.646580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1203/2397] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:43:10 2022] DELETE /identity/v3/projects/687bd82e22fd49938ac9df953706f142 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:43:10.651852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa88ee-daa7-4ef7-94a1-758db531bc9d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:10.652807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa88ee-daa7-4ef7-94a1-758db531bc9d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:10.653232 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa88ee-daa7-4ef7-94a1-758db531bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:10.711019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-56aa88ee-daa7-4ef7-94a1-758db531bc9d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:10.714018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-56aa88ee-daa7-4ef7-94a1-758db531bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:10.857882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1195/2398] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:10.866566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9885-f6aa-4747-bdcf-e45efbd33bcc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:10.866962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9885-f6aa-4747-bdcf-e45efbd33bcc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:10.867196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9885-f6aa-4747-bdcf-e45efbd33bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:10.923669 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2f6c9885-f6aa-4747-bdcf-e45efbd33bcc None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:10.924402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2f6c9885-f6aa-4747-bdcf-e45efbd33bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:10.994057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1204/2399] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:10.996493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa88ee-daa7-4ef7-94a1-758db531bc9d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:11.027451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa88ee-daa7-4ef7-94a1-758db531bc9d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:11.040955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:11.043207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:11.043487 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:11.046222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:11.048796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:43:11.050879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:11.061879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:11.100617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1196/2400] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:43:11.101992 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9885-f6aa-4747-bdcf-e45efbd33bcc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:11.127822 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9885-f6aa-4747-bdcf-e45efbd33bcc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:11.142736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d99e-28b1-4caa-b8c1-a09af7580ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:11.143394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d99e-28b1-4caa-b8c1-a09af7580ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:11.143693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d99e-28b1-4caa-b8c1-a09af7580ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:11.143968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57d99e-28b1-4caa-b8c1-a09af7580ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:11.144638 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57d99e-28b1-4caa-b8c1-a09af7580ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:11.149102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57d99e-28b1-4caa-b8c1-a09af7580ee8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:11.314985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1205/2401] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:43:11 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:43:11.319348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:11.335384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9e2b-4448-4e34-bfce-01a77c6e544d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:11.462766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8492aef-5cf9-4587-b623-f4570d6aee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:11.463712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492aef-5cf9-4587-b623-f4570d6aee83 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:11.463712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492aef-5cf9-4587-b623-f4570d6aee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:11.464093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492aef-5cf9-4587-b623-f4570d6aee83 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:11.464655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8492aef-5cf9-4587-b623-f4570d6aee83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:11.466580 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8492aef-5cf9-4587-b623-f4570d6aee83 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:11.616384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1197/2402] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:43:11 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:43:11.617627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d99e-28b1-4caa-b8c1-a09af7580ee8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:11.638122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57d99e-28b1-4caa-b8c1-a09af7580ee8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:11.650333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d803-58b9-4e05-b709-33909eda07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:11.650966 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d803-58b9-4e05-b709-33909eda07d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:11.651928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d803-58b9-4e05-b709-33909eda07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:11.651928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628d803-58b9-4e05-b709-33909eda07d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:11.652207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628d803-58b9-4e05-b709-33909eda07d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:11.653767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628d803-58b9-4e05-b709-33909eda07d3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:11.683592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1206/2403] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:43:11.684831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8492aef-5cf9-4587-b623-f4570d6aee83 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:11.701171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8492aef-5cf9-4587-b623-f4570d6aee83 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:11.710394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44275dc8-1979-4ddd-95b1-ec5196abb92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:11.711024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44275dc8-1979-4ddd-95b1-ec5196abb92b admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:11.711311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44275dc8-1979-4ddd-95b1-ec5196abb92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:11.711689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44275dc8-1979-4ddd-95b1-ec5196abb92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:11.712220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44275dc8-1979-4ddd-95b1-ec5196abb92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:11.713834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44275dc8-1979-4ddd-95b1-ec5196abb92b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:11.729480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1198/2404] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:43:11.730798 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d803-58b9-4e05-b709-33909eda07d3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:11.746861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628d803-58b9-4e05-b709-33909eda07d3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:11.758879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:11.759508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:11.760062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:11.760356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] PATH_INFO: `/v3/projects/3d0ac9bc87c1477499c48856c5ccd5d5/users/26ef04369c1c4b96930ec99a231c6ce8/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:11.806897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0ac9bc87c1477499c48856c5ccd5d5, user_id=26ef04369c1c4b96930ec99a231c6ce8, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:11.815624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:11.907876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1207/2405] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:43:11 2022] PUT /identity/v3/projects/3d0ac9bc87c1477499c48856c5ccd5d5/users/26ef04369c1c4b96930ec99a231c6ce8/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:43:11.912847 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb4c1-a889-4001-b7d2-d489cbff60f5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:11.913129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb4c1-a889-4001-b7d2-d489cbff60f5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:11.913608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eb4c1-a889-4001-b7d2-d489cbff60f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:11.958560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c90eb4c1-a889-4001-b7d2-d489cbff60f5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:11.960079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c90eb4c1-a889-4001-b7d2-d489cbff60f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:12.006135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:12.105464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1199/2406] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:12.168136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:12.170214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:12.308747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:12.352933 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0a4f1-eafa-4f94-bb4d-b91079235667 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:12.364403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:12.367486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:12.367486 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:12.370225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:12.396177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:12.401867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:12.439696 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1208/2407] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:15.400041 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f0082-993a-4164-9000-0ca7f7a0b49f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:15.401451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f0082-993a-4164-9000-0ca7f7a0b49f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:15.401925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f0082-993a-4164-9000-0ca7f7a0b49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:15.453902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ce2f0082-993a-4164-9000-0ca7f7a0b49f None None] MFA Rules not processed for user `26ef04369c1c4b96930ec99a231c6ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:15.455666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ce2f0082-993a-4164-9000-0ca7f7a0b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:15.599001 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1200/2408] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:15.609243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:15.611765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:15.789884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b96b6-6cd1-4ab8-98f9-c21d28993abb service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:15.801284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:15.801935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:15.807227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:15.807227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:15.824289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:15.848554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:15.888987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1209/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:19.716150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595dfa-206f-4edd-846f-824e9d6b2098 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:19.716954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595dfa-206f-4edd-846f-824e9d6b2098 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:19.716954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595dfa-206f-4edd-846f-824e9d6b2098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:19.743004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-33595dfa-206f-4edd-846f-824e9d6b2098 None None] MFA Rules not processed for user `26ef04369c1c4b96930ec99a231c6ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:19.750252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-33595dfa-206f-4edd-846f-824e9d6b2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:19.755960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1201/2410] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:21.687893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:21.690461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:21.722382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf769d-65a5-468d-9c6f-9b014387c540 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:21.727090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156cc46-11fa-4546-b652-e38f4d8a5287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:21.728980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156cc46-11fa-4546-b652-e38f4d8a5287 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:21.729442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156cc46-11fa-4546-b652-e38f4d8a5287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:21.729892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156cc46-11fa-4546-b652-e38f4d8a5287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:21.735991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7156cc46-11fa-4546-b652-e38f4d8a5287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:21.912459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156cc46-11fa-4546-b652-e38f4d8a5287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:21.914589 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156cc46-11fa-4546-b652-e38f4d8a5287 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:21.932213 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1210/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:26.153384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595dfa-206f-4edd-846f-824e9d6b2098 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:26.167661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595dfa-206f-4edd-846f-824e9d6b2098 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:26.174275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8fc51-0682-421a-81ca-e201fbee636d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:26.174892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8fc51-0682-421a-81ca-e201fbee636d service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:26.175549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8fc51-0682-421a-81ca-e201fbee636d service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:26.181570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8fc51-0682-421a-81ca-e201fbee636d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:26.181570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-07d8fc51-0682-421a-81ca-e201fbee636d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:26.321369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8fc51-0682-421a-81ca-e201fbee636d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:26.323179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8fc51-0682-421a-81ca-e201fbee636d service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:26.337667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1202/2412] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:43:29.111370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf114e9a-60c7-4dc1-8185-affbc97126ef None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:29.113530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf114e9a-60c7-4dc1-8185-affbc97126ef None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:29.114166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf114e9a-60c7-4dc1-8185-affbc97126ef None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:29.117740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1211/2413] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:43:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:43:29.125246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e51843-829c-4e72-8fb5-ea8022116bb7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:29.126498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e51843-829c-4e72-8fb5-ea8022116bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:29.127051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e51843-829c-4e72-8fb5-ea8022116bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:29.170340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-30e51843-829c-4e72-8fb5-ea8022116bb7 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:29.172810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-30e51843-829c-4e72-8fb5-ea8022116bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:29.301135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:29.391817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1203/2414] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:43:29.400603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf114e9a-60c7-4dc1-8185-affbc97126ef None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:29.402429 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cf114e9a-60c7-4dc1-8185-affbc97126ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:29.511184 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf114e9a-60c7-4dc1-8185-affbc97126ef None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:29.517295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02955d16-4929-47d2-8fa7-11199aa45779 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71dca3ee8b78402eb95815eb200d90a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:29.517934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02955d16-4929-47d2-8fa7-11199aa45779 service glance] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:29.518290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02955d16-4929-47d2-8fa7-11199aa45779 service glance] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:29.518517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02955d16-4929-47d2-8fa7-11199aa45779 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:29.532351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02955d16-4929-47d2-8fa7-11199aa45779 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:29.533825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02955d16-4929-47d2-8fa7-11199aa45779 service glance] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:29.547122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1212/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:29.843124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24db1d-3aad-4334-917d-2701dc949b08 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:29.844242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24db1d-3aad-4334-917d-2701dc949b08 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:29.844521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24db1d-3aad-4334-917d-2701dc949b08 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:29.847617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1204/2416] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:43:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:43:29.854091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1cd1-bd05-4424-aeac-cf0c4283a7a7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:29.854371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1cd1-bd05-4424-aeac-cf0c4283a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:29.854869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1cd1-bd05-4424-aeac-cf0c4283a7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:29.882132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-21fa1cd1-bd05-4424-aeac-cf0c4283a7a7 None None] MFA Rules not processed for user `75252b7cba4943b2874983d1a83a9175`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:29.883772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-21fa1cd1-bd05-4424-aeac-cf0c4283a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:29.892770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1213/2417] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:29.952947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24db1d-3aad-4334-917d-2701dc949b08 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:29.981635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24db1d-3aad-4334-917d-2701dc949b08 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:29.989709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac62ef-50de-453a-8dda-9e2bfb68d1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:29.990879 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac62ef-50de-453a-8dda-9e2bfb68d1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:29.991350 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac62ef-50de-453a-8dda-9e2bfb68d1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:29.991782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac62ef-50de-453a-8dda-9e2bfb68d1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:30.004478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac62ef-50de-453a-8dda-9e2bfb68d1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:30.006345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac62ef-50de-453a-8dda-9e2bfb68d1f2 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:30.022338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1205/2418] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:30.374687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e6e7-42b3-45c5-8260-51be443eb911 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:30.375738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e6e7-42b3-45c5-8260-51be443eb911 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:30.375738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946e6e7-42b3-45c5-8260-51be443eb911 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:30.376697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1214/2419] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:43:30.388971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3794-3f9f-49a6-9ae3-dbda0f098945 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:30.390414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3794-3f9f-49a6-9ae3-dbda0f098945 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:30.391441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3794-3f9f-49a6-9ae3-dbda0f098945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:30.457789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-450c3794-3f9f-49a6-9ae3-dbda0f098945 None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:30.475801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-450c3794-3f9f-49a6-9ae3-dbda0f098945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:30.528618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1206/2420] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:43:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:43:30.550351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e6e7-42b3-45c5-8260-51be443eb911 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:30.567392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946e6e7-42b3-45c5-8260-51be443eb911 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:30.580053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:30.581483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:30.582029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:30.582874 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:30.624897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:30.627503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:30.652160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1215/2421] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:43:36.349733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20896af2-2aa2-4aef-bf6b-2a7f3cb4c844 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:36.350256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20896af2-2aa2-4aef-bf6b-2a7f3cb4c844 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:36.350350 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20896af2-2aa2-4aef-bf6b-2a7f3cb4c844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:36.369923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-20896af2-2aa2-4aef-bf6b-2a7f3cb4c844 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:36.371176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-20896af2-2aa2-4aef-bf6b-2a7f3cb4c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:36.427849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1207/2422] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 22 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:36.441500 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:36.443155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:36.450443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:36.518899 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639131c-dddc-489f-86b7-9b4f4a89995f service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:36.524285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab426c-1fe6-4535-b6cf-fd9bd9851d9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:36.524909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab426c-1fe6-4535-b6cf-fd9bd9851d9e service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:36.525193 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab426c-1fe6-4535-b6cf-fd9bd9851d9e service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:36.525473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab426c-1fe6-4535-b6cf-fd9bd9851d9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:36.534509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab426c-1fe6-4535-b6cf-fd9bd9851d9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:36.536112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab426c-1fe6-4535-b6cf-fd9bd9851d9e service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:36.544817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1216/2423] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:43:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:43:38.590936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6b5e2-6f5a-4e9a-8eaa-ea56b64af6fc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:38.591575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6b5e2-6f5a-4e9a-8eaa-ea56b64af6fc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:38.591575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6b5e2-6f5a-4e9a-8eaa-ea56b64af6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:38.613078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9cd6b5e2-6f5a-4e9a-8eaa-ea56b64af6fc None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:38.614555 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9cd6b5e2-6f5a-4e9a-8eaa-ea56b64af6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:38.622935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1208/2424] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:43:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:38.635794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab426c-1fe6-4535-b6cf-fd9bd9851d9e service swift] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:38.648733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab426c-1fe6-4535-b6cf-fd9bd9851d9e service swift] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:38.657485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5499f-b373-47a7-9ddc-d2c7534c5b73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:38.657485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5499f-b373-47a7-9ddc-d2c7534c5b73 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:38.657485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5499f-b373-47a7-9ddc-d2c7534c5b73 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:38.657485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5499f-b373-47a7-9ddc-d2c7534c5b73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:38.666972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5499f-b373-47a7-9ddc-d2c7534c5b73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:38.668575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5499f-b373-47a7-9ddc-d2c7534c5b73 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:38.678246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1217/2425] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:43:40.089401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6b5e2-6f5a-4e9a-8eaa-ea56b64af6fc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:40.094036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9cd6b5e2-6f5a-4e9a-8eaa-ea56b64af6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:40.108100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6b5e2-6f5a-4e9a-8eaa-ea56b64af6fc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:40.113472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:40.114225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:40.114590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:40.114930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] PATH_INFO: `/v3/users/f818e4ca845c474081b7c49994ee3737` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:40.116169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f818e4ca845c474081b7c49994ee3737)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:40.118239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:40.312042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f818e4ca845c474081b7c49994ee3737'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:40.343939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f818e4ca845c474081b7c49994ee3737'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:40.422933 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f818e4ca845c474081b7c49994ee3737'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:40.423959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f818e4ca845c474081b7c49994ee3737'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:40.442751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-acd12d89-6abb-4a3c-aefb-53908607733f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f818e4ca845c474081b7c49994ee3737'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:40.457849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1209/2426] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:43:40 2022] DELETE /identity/v3/users/f818e4ca845c474081b7c49994ee3737 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:43:40.772399 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5499f-b373-47a7-9ddc-d2c7534c5b73 service swift] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:40.783181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5499f-b373-47a7-9ddc-d2c7534c5b73 service swift] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:40.895742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:40.896411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:40.896833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:40.897126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] PATH_INFO: `/v3/projects/85216b6544be4d43abc5ab10a15e93e2` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:40.898625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=85216b6544be4d43abc5ab10a15e93e2)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:40.901153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:41.074653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85216b6544be4d43abc5ab10a15e93e2', 'request_id': 'req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:41.165799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85216b6544be4d43abc5ab10a15e93e2', 'request_id': 'req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:41.174386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85216b6544be4d43abc5ab10a15e93e2', 'request_id': 'req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:41.185783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] The token cache is being invalidate because project 85216b6544be4d43abc5ab10a15e93e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:43:41.186073 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:41.186753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-960c2636-3217-4fa3-a8c8-e0e99e1ec8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:41.188352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1218/2427] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:43:40 2022] DELETE /identity/v3/projects/85216b6544be4d43abc5ab10a15e93e2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:43:41.193666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76064a-68b7-40e1-b3ae-b533016acde3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:41.194342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76064a-68b7-40e1-b3ae-b533016acde3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:41.194342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76064a-68b7-40e1-b3ae-b533016acde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:41.214592 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5d76064a-68b7-40e1-b3ae-b533016acde3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:41.215820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5d76064a-68b7-40e1-b3ae-b533016acde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:41.236959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:41.281869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1210/2428] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:41.291477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4f03a-1eaf-4eac-bc0c-7ab00c90c47f None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:41.292048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4f03a-1eaf-4eac-bc0c-7ab00c90c47f None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:41.292544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4f03a-1eaf-4eac-bc0c-7ab00c90c47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:41.317750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9fe4f03a-1eaf-4eac-bc0c-7ab00c90c47f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:41.319978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9fe4f03a-1eaf-4eac-bc0c-7ab00c90c47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:41.332012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1219/2429] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:43:41.338679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76064a-68b7-40e1-b3ae-b533016acde3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:41.359980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76064a-68b7-40e1-b3ae-b533016acde3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:41.366953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:41.367667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:41.367949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:41.368300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:41.368968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:43:41.369271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:41.370940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:41.411634 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1211/2430] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:43:41.411851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4f03a-1eaf-4eac-bc0c-7ab00c90c47f None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:41.417054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:41.421875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4f03a-1eaf-4eac-bc0c-7ab00c90c47f None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:41.426964 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acef0f-f94a-4706-8727-a068d8412661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:41.431946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acef0f-f94a-4706-8727-a068d8412661 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:41.431946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acef0f-f94a-4706-8727-a068d8412661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:41.431946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acef0f-f94a-4706-8727-a068d8412661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:41.431946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acef0f-f94a-4706-8727-a068d8412661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:41.431946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acef0f-f94a-4706-8727-a068d8412661 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:41.542389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1220/2431] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:43:41 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:43:41.543766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:41.567498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e6f7e-5e46-479d-8958-b7398cfaed95 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:41.645923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb8c84-f054-404a-b757-808991365390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:41.646572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8c84-f054-404a-b757-808991365390 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:41.646856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8c84-f054-404a-b757-808991365390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:41.647131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb8c84-f054-404a-b757-808991365390 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:41.647772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8c84-f054-404a-b757-808991365390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:41.649716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb8c84-f054-404a-b757-808991365390 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:41.796491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1212/2432] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:43:41 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:43:41.801379 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acef0f-f94a-4706-8727-a068d8412661 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:41.815180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acef0f-f94a-4706-8727-a068d8412661 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:41.820237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aac53-b289-4758-ad19-2d5aacbc2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:41.820854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aac53-b289-4758-ad19-2d5aacbc2026 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:41.821336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aac53-b289-4758-ad19-2d5aacbc2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:41.821773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aac53-b289-4758-ad19-2d5aacbc2026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:41.822631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aac53-b289-4758-ad19-2d5aacbc2026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:41.824426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aac53-b289-4758-ad19-2d5aacbc2026 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:41.836313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1221/2433] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:43:41.841036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb8c84-f054-404a-b757-808991365390 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:41.855640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb8c84-f054-404a-b757-808991365390 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:41.861923 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73b77e-2aaa-4348-942f-837840064ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:41.862834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b77e-2aaa-4348-942f-837840064ece admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:41.863260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b77e-2aaa-4348-942f-837840064ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:41.863632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b77e-2aaa-4348-942f-837840064ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:41.864549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73b77e-2aaa-4348-942f-837840064ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:41.866652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73b77e-2aaa-4348-942f-837840064ece admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:41.878987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1213/2434] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:43:41.883684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aac53-b289-4758-ad19-2d5aacbc2026 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:41.897518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aac53-b289-4758-ad19-2d5aacbc2026 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:41.903592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:41.904740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:41.905183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:41.905694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] PATH_INFO: `/v3/projects/f1768048247844039b323b9445eb88c2/users/dcb359c458c944909d0a7a8c0d97935f/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:41.924726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1768048247844039b323b9445eb88c2, user_id=dcb359c458c944909d0a7a8c0d97935f, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:41.927671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:42.015532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1222/2435] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:43:41 2022] PUT /identity/v3/projects/f1768048247844039b323b9445eb88c2/users/dcb359c458c944909d0a7a8c0d97935f/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:43:42.025785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ff4b-6f89-4d7c-8ca1-bcfc9c73c587 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:42.026106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ff4b-6f89-4d7c-8ca1-bcfc9c73c587 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:42.026380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ff4b-6f89-4d7c-8ca1-bcfc9c73c587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:42.062911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-10d8ff4b-6f89-4d7c-8ca1-bcfc9c73c587 None None] MFA Rules not processed for user `dcb359c458c944909d0a7a8c0d97935f`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:42.064446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-10d8ff4b-6f89-4d7c-8ca1-bcfc9c73c587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:42.180057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1214/2436] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:42.192468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:42.193947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:42.260505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81cf8-9921-4e00-a031-2ff839865b62 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:42.265414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7ae0-6954-4632-bcd5-ae6eaa452b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:42.266067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7ae0-6954-4632-bcd5-ae6eaa452b6e service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:42.266680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7ae0-6954-4632-bcd5-ae6eaa452b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:42.266961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7ae0-6954-4632-bcd5-ae6eaa452b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:42.276077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f7ae0-6954-4632-bcd5-ae6eaa452b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:42.277694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f7ae0-6954-4632-bcd5-ae6eaa452b6e service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:42.289049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1223/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:51.581559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf408-9bad-4a05-8e38-0b07cf8e04b6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:51.582233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf408-9bad-4a05-8e38-0b07cf8e04b6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:51.582233 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf408-9bad-4a05-8e38-0b07cf8e04b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:51.602154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-cb4cf408-9bad-4a05-8e38-0b07cf8e04b6 None None] MFA Rules not processed for user `e4c7cd885cc24bf2934e4e9cecb50ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:51.603462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cb4cf408-9bad-4a05-8e38-0b07cf8e04b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:51.616704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:51.662440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1215/2438] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:52.284553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=48,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:54.874248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7ae0-6954-4632-bcd5-ae6eaa452b6e service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:54.942642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7ae0-6954-4632-bcd5-ae6eaa452b6e service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:54.947548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:54.948172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:54.948517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:54.948906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] PATH_INFO: `/v3/users/dcb359c458c944909d0a7a8c0d97935f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:54.955325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb359c458c944909d0a7a8c0d97935f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:54.955325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:55.181352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb359c458c944909d0a7a8c0d97935f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:55.181989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb359c458c944909d0a7a8c0d97935f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:55.190163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb359c458c944909d0a7a8c0d97935f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:55.203701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb359c458c944909d0a7a8c0d97935f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:55.204405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb359c458c944909d0a7a8c0d97935f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:55.282094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1224/2439] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:43:54 2022] DELETE /identity/v3/users/dcb359c458c944909d0a7a8c0d97935f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:43:55.286390 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f1b8-a4ac-42d9-97b9-063ac8aa9e48 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:55.286862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f1b8-a4ac-42d9-97b9-063ac8aa9e48 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:55.286967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770f1b8-a4ac-42d9-97b9-063ac8aa9e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:55.306921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2770f1b8-a4ac-42d9-97b9-063ac8aa9e48 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:55.308516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2770f1b8-a4ac-42d9-97b9-063ac8aa9e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:55.373279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1216/2440] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:43:55.383168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:55.384575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:55.444666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ea04f-9019-489a-8dd9-84956235f10d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:55.448687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13427f-fa04-4d09-98f1-7b5a7cc7db1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:55.449299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13427f-fa04-4d09-98f1-7b5a7cc7db1e service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:55.449648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13427f-fa04-4d09-98f1-7b5a7cc7db1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:55.449925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13427f-fa04-4d09-98f1-7b5a7cc7db1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:55.461124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13427f-fa04-4d09-98f1-7b5a7cc7db1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:55.462606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13427f-fa04-4d09-98f1-7b5a7cc7db1e service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:55.472470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1225/2441] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:43:55.949326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770f1b8-a4ac-42d9-97b9-063ac8aa9e48 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:55.951513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2770f1b8-a4ac-42d9-97b9-063ac8aa9e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:55.974917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770f1b8-a4ac-42d9-97b9-063ac8aa9e48 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:55.982126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:55.986188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:55.986188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:55.986188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] PATH_INFO: `/v3/projects/f1768048247844039b323b9445eb88c2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:55.986188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1768048247844039b323b9445eb88c2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:55.987980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:56.140917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1768048247844039b323b9445eb88c2', 'request_id': 'req-8e4d7171-7cea-4243-b2a2-76a01a2ab590'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:56.216486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1768048247844039b323b9445eb88c2', 'request_id': 'req-8e4d7171-7cea-4243-b2a2-76a01a2ab590'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:56.223049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1768048247844039b323b9445eb88c2', 'request_id': 'req-8e4d7171-7cea-4243-b2a2-76a01a2ab590'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:56.235539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] The token cache is being invalidate because project f1768048247844039b323b9445eb88c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:43:56.235934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:56.236670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:43:56.248518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1217/2442] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:43:55 2022] DELETE /identity/v3/projects/f1768048247844039b323b9445eb88c2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:43:59.549830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d8715-61fb-40f3-a7c6-f192ea8957a7 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:59.550371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d8715-61fb-40f3-a7c6-f192ea8957a7 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:59.550455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d8715-61fb-40f3-a7c6-f192ea8957a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:59.582858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-592d8715-61fb-40f3-a7c6-f192ea8957a7 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:43:59.584102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-592d8715-61fb-40f3-a7c6-f192ea8957a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:59.603884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:59.645059 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1226/2443] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 22 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:43:59.659155 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:43:59.661020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:43:59.717774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:43:59.739733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d7171-7cea-4243-b2a2-76a01a2ab590 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:43:59.745353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:43:59.746696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:43:59.747150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:43:59.747954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:43:59.757032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:43:59.758722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:43:59.768065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1218/2444] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:43:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:44:09.703590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=15 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:44:09.818939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=10 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:44:18.237510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9f6e8-e81e-408e-aaed-d3584cb691f6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:18.245362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9f6e8-e81e-408e-aaed-d3584cb691f6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:18.245362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9f6e8-e81e-408e-aaed-d3584cb691f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:18.260207 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-75c9f6e8-e81e-408e-aaed-d3584cb691f6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:44:18.261423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-75c9f6e8-e81e-408e-aaed-d3584cb691f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:18.324592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1227/2445] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:44:18.350747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:44:18.352187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:18.428185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5eab89-56d7-44d8-a31e-b2d540025800 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:44:18.433964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb685a-6c3b-4086-bf8d-98b1ef282d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:44:18.435300 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb685a-6c3b-4086-bf8d-98b1ef282d99 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:18.435578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb685a-6c3b-4086-bf8d-98b1ef282d99 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:18.435853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb685a-6c3b-4086-bf8d-98b1ef282d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:18.445427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb685a-6c3b-4086-bf8d-98b1ef282d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:44:18.447057 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb685a-6c3b-4086-bf8d-98b1ef282d99 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:44:18.458129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1219/2446] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:44:20.221463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419482a-aa3a-4953-bb7c-297ef132ecaa None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:20.222075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419482a-aa3a-4953-bb7c-297ef132ecaa None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:20.222075 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419482a-aa3a-4953-bb7c-297ef132ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:20.243457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5419482a-aa3a-4953-bb7c-297ef132ecaa None None] MFA Rules not processed for user `e31c29dd5cbb4ede8989904bfe4416ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:44:20.245198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5419482a-aa3a-4953-bb7c-297ef132ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:20.302508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1228/2447] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:44:23.716326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d14c7-7484-4b46-9f07-06a252685e7a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:23.716862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d14c7-7484-4b46-9f07-06a252685e7a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:23.716862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d14c7-7484-4b46-9f07-06a252685e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:23.737794 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-072d14c7-7484-4b46-9f07-06a252685e7a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:44:23.739051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-072d14c7-7484-4b46-9f07-06a252685e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:23.747183 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1220/2448] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:44:23.764048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419482a-aa3a-4953-bb7c-297ef132ecaa None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:44:23.776900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419482a-aa3a-4953-bb7c-297ef132ecaa None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:44:23.783808 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:44:23.784433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:23.784869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:23.785170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:23.795384 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:44:23.797069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:44:23.822183 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1229/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:44:28.176809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa23a-8723-425d-9c8c-46e85d56cea4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:28.177436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa23a-8723-425d-9c8c-46e85d56cea4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:28.177436 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa23a-8723-425d-9c8c-46e85d56cea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:28.197912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e98fa23a-8723-425d-9c8c-46e85d56cea4 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:44:28.199172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e98fa23a-8723-425d-9c8c-46e85d56cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:28.207761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1221/2450] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:44:28.222957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:44:28.224433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:28.239274 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9c09-dbb8-44ea-a6d9-456eed477a5c service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:44:28.245530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf91dd8-76b8-4516-a10d-16e99cc459a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:44:28.246052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91dd8-76b8-4516-a10d-16e99cc459a8 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:28.246343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91dd8-76b8-4516-a10d-16e99cc459a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:28.247231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91dd8-76b8-4516-a10d-16e99cc459a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:28.256349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf91dd8-76b8-4516-a10d-16e99cc459a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:44:28.257934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf91dd8-76b8-4516-a10d-16e99cc459a8 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:44:28.268280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1230/2451] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:44:32.056389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67d21-ae1f-4fbc-97ec-69b71fe72fc0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:32.056898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67d21-ae1f-4fbc-97ec-69b71fe72fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:32.056994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f67d21-ae1f-4fbc-97ec-69b71fe72fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:32.077534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-78f67d21-ae1f-4fbc-97ec-69b71fe72fc0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:44:32.078785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-78f67d21-ae1f-4fbc-97ec-69b71fe72fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:32.086740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1222/2452] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:44:32.103731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf91dd8-76b8-4516-a10d-16e99cc459a8 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:44:32.115562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf91dd8-76b8-4516-a10d-16e99cc459a8 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:44:32.121508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6061-7666-44b5-acbb-7bbe86980a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:44:32.122247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6061-7666-44b5-acbb-7bbe86980a69 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:32.122482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6061-7666-44b5-acbb-7bbe86980a69 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:32.122807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d6061-7666-44b5-acbb-7bbe86980a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:32.132079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d6061-7666-44b5-acbb-7bbe86980a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:44:32.133676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d6061-7666-44b5-acbb-7bbe86980a69 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:44:32.144028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1231/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:44:36.371800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02b8-2b94-41ee-80be-40bc3f5bbcd6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:36.372396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02b8-2b94-41ee-80be-40bc3f5bbcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:36.372396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02b8-2b94-41ee-80be-40bc3f5bbcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:36.393854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9d2a02b8-2b94-41ee-80be-40bc3f5bbcd6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:44:36.395116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9d2a02b8-2b94-41ee-80be-40bc3f5bbcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:36.403845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1223/2454] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:44:36.422342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6061-7666-44b5-acbb-7bbe86980a69 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:44:36.433796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d6061-7666-44b5-acbb-7bbe86980a69 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:44:36.439827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b1b29-9fc8-433b-8b40-41c23b9926f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:44:36.440447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1b29-9fc8-433b-8b40-41c23b9926f3 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:36.440722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1b29-9fc8-433b-8b40-41c23b9926f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:36.440989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1b29-9fc8-433b-8b40-41c23b9926f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:36.450026 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b1b29-9fc8-433b-8b40-41c23b9926f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:44:36.451984 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b1b29-9fc8-433b-8b40-41c23b9926f3 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:44:36.462666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1232/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:44:40.634583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa7edf-44d9-41f7-9455-3a4ef7aa0957 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:40.635162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa7edf-44d9-41f7-9455-3a4ef7aa0957 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:40.635162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa7edf-44d9-41f7-9455-3a4ef7aa0957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:40.642880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=47 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:44:40.778668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-71aa7edf-44d9-41f7-9455-3a4ef7aa0957 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:44:40.779935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-71aa7edf-44d9-41f7-9455-3a4ef7aa0957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:40.787845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1224/2456] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:44:40.807796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b1b29-9fc8-433b-8b40-41c23b9926f3 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:44:40.814275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=77 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:44:40.820149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b1b29-9fc8-433b-8b40-41c23b9926f3 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:44:40.825639 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:44:40.826393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:40.826731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:40.827410 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:40.835850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:44:40.837378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:44:40.847650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1233/2457] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:44:46.773685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa7edf-44d9-41f7-9455-3a4ef7aa0957 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:44:46.775585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-71aa7edf-44d9-41f7-9455-3a4ef7aa0957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:46.831857 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa7edf-44d9-41f7-9455-3a4ef7aa0957 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:44:46.835404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:44:46.835993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:46.836268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:46.836533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:46.838310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:46.851370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:44:46.852755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:44:46.863897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1225/2458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:44:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:44:50.849904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:44:52.254844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:44:52.256294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:52.315011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bab75-ce9e-4d23-b790-1492eca50f1d service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:44:52.318635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286e0bf-982b-4c4f-8bea-f0a5977d5c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:44:52.319243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e0bf-982b-4c4f-8bea-f0a5977d5c57 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:44:52.319519 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e0bf-982b-4c4f-8bea-f0a5977d5c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:44:52.319851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e0bf-982b-4c4f-8bea-f0a5977d5c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:44:52.321625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7286e0bf-982b-4c4f-8bea-f0a5977d5c57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:44:52.335284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286e0bf-982b-4c4f-8bea-f0a5977d5c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:44:52.336711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286e0bf-982b-4c4f-8bea-f0a5977d5c57 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:44:52.348289 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1234/2459] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:44:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:44:56.858625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=28 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:01.565507 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:01.578973 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63876f1e-ec4c-4261-9cab-85df1fe5673c service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:01.586040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:01.586654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:01.587101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:01.587531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:01.589717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:01.709928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:01.712423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:01.730700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1226/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:02.343377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=26 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:06.486517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448d52-c4cd-4d3d-a064-2d7121b366c0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:06.487225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448d52-c4cd-4d3d-a064-2d7121b366c0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:06.487225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56448d52-c4cd-4d3d-a064-2d7121b366c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:06.509680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-56448d52-c4cd-4d3d-a064-2d7121b366c0 None None] MFA Rules not processed for user `26ef04369c1c4b96930ec99a231c6ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:06.511169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-56448d52-c4cd-4d3d-a064-2d7121b366c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:06.590645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1235/2461] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:45:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:06.855318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:06.864949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c16ec3-67be-4138-ad51-acfe41853bc1 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:06.868749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cfd98-1898-4a1c-a5ee-ba2b6d824874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:06.871952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd98-1898-4a1c-a5ee-ba2b6d824874 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:06.871952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd98-1898-4a1c-a5ee-ba2b6d824874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:06.871952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cfd98-1898-4a1c-a5ee-ba2b6d824874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:06.871952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2e4cfd98-1898-4a1c-a5ee-ba2b6d824874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:06.882435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cfd98-1898-4a1c-a5ee-ba2b6d824874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:06.883957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cfd98-1898-4a1c-a5ee-ba2b6d824874 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:06.893036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1227/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:45:07.340172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56448d52-c4cd-4d3d-a064-2d7121b366c0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:07.341719 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-56448d52-c4cd-4d3d-a064-2d7121b366c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:07.422818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56448d52-c4cd-4d3d-a064-2d7121b366c0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:07.427970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:07.428613 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:07.428892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:07.429164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:07.430897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:07.443380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:07.445008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:07.458157 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1236/2463] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:07.561700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559fedb-edbe-4cf5-8a20-dc5a7db53b71 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:07.565940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559fedb-edbe-4cf5-8a20-dc5a7db53b71 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:07.565940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559fedb-edbe-4cf5-8a20-dc5a7db53b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:07.583962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b559fedb-edbe-4cf5-8a20-dc5a7db53b71 None None] MFA Rules not processed for user `2b0375d6cd584faeab759ff9f5cd98f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:07.585338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b559fedb-edbe-4cf5-8a20-dc5a7db53b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:07.643263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1228/2464] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:16.709879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:16.723618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559fedb-edbe-4cf5-8a20-dc5a7db53b71 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:16.724218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ded49-cb2b-448a-9e67-e6bef8ccf3f5 service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:16.725130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b559fedb-edbe-4cf5-8a20-dc5a7db53b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:16.728145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:16.728904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:16.733724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:16.733724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:16.733724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:16.741021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559fedb-edbe-4cf5-8a20-dc5a7db53b71 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:16.745284 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdfeed-fd2c-43f7-80f0-09627fd4ef38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:16.745907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdfeed-fd2c-43f7-80f0-09627fd4ef38 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:16.746401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdfeed-fd2c-43f7-80f0-09627fd4ef38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:16.746853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdfeed-fd2c-43f7-80f0-09627fd4ef38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:16.758304 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:16.758426 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdfeed-fd2c-43f7-80f0-09627fd4ef38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:16.759820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdfeed-fd2c-43f7-80f0-09627fd4ef38 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:16.760201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:16.772309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1237/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:16.786273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1229/2466] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:45:16.791912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:16.817948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51fe4f-a6ae-4505-b378-1d91e980ce99 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:16.823028 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa06fb-cdbe-499c-bc88-fc6726c2dce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:16.823658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa06fb-cdbe-499c-bc88-fc6726c2dce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:16.824057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa06fb-cdbe-499c-bc88-fc6726c2dce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:16.826004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa06fb-cdbe-499c-bc88-fc6726c2dce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:16.837840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa06fb-cdbe-499c-bc88-fc6726c2dce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:16.839568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa06fb-cdbe-499c-bc88-fc6726c2dce0 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:16.854667 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1238/2467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:22.773614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdfeed-fd2c-43f7-80f0-09627fd4ef38 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:22.783125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdfeed-fd2c-43f7-80f0-09627fd4ef38 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:22.787017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:22.787716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:22.788176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:22.788511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:22.790326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:22.803204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:22.804724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:22.815418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1230/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:45:23.169513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa06fb-cdbe-499c-bc88-fc6726c2dce0 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:23.195895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa06fb-cdbe-499c-bc88-fc6726c2dce0 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:23.207515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcf985-ddaf-4502-92e2-5e0719632966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:23.208447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf985-ddaf-4502-92e2-5e0719632966 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:23.208904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf985-ddaf-4502-92e2-5e0719632966 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:23.209231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcf985-ddaf-4502-92e2-5e0719632966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:23.211108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d0fcf985-ddaf-4502-92e2-5e0719632966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:23.230925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcf985-ddaf-4502-92e2-5e0719632966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:23.232660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcf985-ddaf-4502-92e2-5e0719632966 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:23.254579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1239/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:24.999579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:25.014051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9bfd-a555-4d67-a2b7-bc51406e6977 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:25.020466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:25.021331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:25.021617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:25.021890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:25.023773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:25.034907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:25.036512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:25.047086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1231/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:25.307801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd166-2007-4774-98d1-11f42801d4dc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:25.308352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd166-2007-4774-98d1-11f42801d4dc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:25.308352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd166-2007-4774-98d1-11f42801d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:25.329541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-100fd166-2007-4774-98d1-11f42801d4dc None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:25.331053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-100fd166-2007-4774-98d1-11f42801d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:25.340571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1240/2471] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 22 14:45:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:25.531106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:25.545017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c8fea-5363-4881-bce0-f07b66636059 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:25.551126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d61e7-5085-4732-83a2-52f678b8ee73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:25.551913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d61e7-5085-4732-83a2-52f678b8ee73 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:25.552262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d61e7-5085-4732-83a2-52f678b8ee73 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:25.553245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d61e7-5085-4732-83a2-52f678b8ee73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:25.564016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d61e7-5085-4732-83a2-52f678b8ee73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:25.565807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d61e7-5085-4732-83a2-52f678b8ee73 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:25.574753 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1232/2472] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:45:27.891432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd166-2007-4774-98d1-11f42801d4dc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:27.893240 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-100fd166-2007-4774-98d1-11f42801d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:27.910556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd166-2007-4774-98d1-11f42801d4dc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:27.917390 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:27.918239 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:27.926424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:27.926424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] PATH_INFO: `/v3/users/e4c7cd885cc24bf2934e4e9cecb50ee8` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:27.926424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c7cd885cc24bf2934e4e9cecb50ee8)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:27.926424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:28.087214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:28.091503 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c7cd885cc24bf2934e4e9cecb50ee8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.092402 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c7cd885cc24bf2934e4e9cecb50ee8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.099958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c7cd885cc24bf2934e4e9cecb50ee8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.114546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c7cd885cc24bf2934e4e9cecb50ee8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.115584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ce380e9b-a0a9-4ee9-9f8f-883d2f7b4ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c7cd885cc24bf2934e4e9cecb50ee8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.199091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1241/2473] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:45:27 2022] DELETE /identity/v3/users/e4c7cd885cc24bf2934e4e9cecb50ee8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:45:28.475343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d61e7-5085-4732-83a2-52f678b8ee73 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:28.481235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=84 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:28.506695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d61e7-5085-4732-83a2-52f678b8ee73 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:28.569407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:28.570094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:28.570377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:28.570653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] PATH_INFO: `/v3/projects/0f63b2df0996478d9c4f8b5c25baa5cb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:28.571898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f63b2df0996478d9c4f8b5c25baa5cb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:28.575992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:28.664741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f63b2df0996478d9c4f8b5c25baa5cb', 'request_id': 'req-c957c47b-d9fe-4aa5-aa8d-6300086475dc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.770409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f63b2df0996478d9c4f8b5c25baa5cb', 'request_id': 'req-c957c47b-d9fe-4aa5-aa8d-6300086475dc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.777064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f63b2df0996478d9c4f8b5c25baa5cb', 'request_id': 'req-c957c47b-d9fe-4aa5-aa8d-6300086475dc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.789866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] The token cache is being invalidate because project 0f63b2df0996478d9c4f8b5c25baa5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:45:28.790184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.790921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c957c47b-d9fe-4aa5-aa8d-6300086475dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:28.792731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1233/2474] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:45:28 2022] DELETE /identity/v3/projects/0f63b2df0996478d9c4f8b5c25baa5cb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:45:28.799755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f15f32-2ca3-4faf-86dc-bb76dd8c7d8c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:28.800047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f15f32-2ca3-4faf-86dc-bb76dd8c7d8c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:28.800324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f15f32-2ca3-4faf-86dc-bb76dd8c7d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:28.822215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b6f15f32-2ca3-4faf-86dc-bb76dd8c7d8c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:28.823440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b6f15f32-2ca3-4faf-86dc-bb76dd8c7d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:28.893741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1242/2475] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:28.901409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f521-8c0b-4531-8f22-9c91a6f3222b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:28.902081 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f521-8c0b-4531-8f22-9c91a6f3222b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:28.902434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9f521-8c0b-4531-8f22-9c91a6f3222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:28.925036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8cb9f521-8c0b-4531-8f22-9c91a6f3222b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:28.927635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8cb9f521-8c0b-4531-8f22-9c91a6f3222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:28.935100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1234/2476] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:28.939754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f15f32-2ca3-4faf-86dc-bb76dd8c7d8c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:28.950569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f15f32-2ca3-4faf-86dc-bb76dd8c7d8c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:28.955556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:28.956165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:28.956621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:28.956918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:28.957746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:45:28.958087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:28.959688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:28.979208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1243/2477] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:45:28.986491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9f521-8c0b-4531-8f22-9c91a6f3222b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:29.002404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9f521-8c0b-4531-8f22-9c91a6f3222b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:29.009451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc25b2-07eb-483c-b69a-3d59b41804fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:29.010473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc25b2-07eb-483c-b69a-3d59b41804fd admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:29.010817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc25b2-07eb-483c-b69a-3d59b41804fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:29.011152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc25b2-07eb-483c-b69a-3d59b41804fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:29.012615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc25b2-07eb-483c-b69a-3d59b41804fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:29.018226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc25b2-07eb-483c-b69a-3d59b41804fd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:29.130926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1235/2478] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:45:28 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:45:29.133158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:29.158792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e890a-5fa6-43b6-870c-91d2b8c9103a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:29.255019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff948-bbbb-47c5-b0f4-dd6722a59ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:29.255812 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff948-bbbb-47c5-b0f4-dd6722a59ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:29.256153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff948-bbbb-47c5-b0f4-dd6722a59ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:29.257573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff948-bbbb-47c5-b0f4-dd6722a59ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:29.257573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff948-bbbb-47c5-b0f4-dd6722a59ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:29.261326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff948-bbbb-47c5-b0f4-dd6722a59ec7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:29.342030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1244/2479] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:45:29 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:45:29.348162 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc25b2-07eb-483c-b69a-3d59b41804fd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:29.359078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc25b2-07eb-483c-b69a-3d59b41804fd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:29.363793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb2854-160b-4b49-9874-a834c8846bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:29.365264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2854-160b-4b49-9874-a834c8846bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:29.365264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2854-160b-4b49-9874-a834c8846bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:29.365264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2854-160b-4b49-9874-a834c8846bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:29.365641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb2854-160b-4b49-9874-a834c8846bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:29.367299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb2854-160b-4b49-9874-a834c8846bb7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:29.378671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1236/2480] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:45:29.382974 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff948-bbbb-47c5-b0f4-dd6722a59ec7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:29.394259 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff948-bbbb-47c5-b0f4-dd6722a59ec7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:29.399362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e70049-c084-42f7-9a97-ee7872897e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:29.400890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70049-c084-42f7-9a97-ee7872897e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:29.401292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70049-c084-42f7-9a97-ee7872897e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:29.401631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70049-c084-42f7-9a97-ee7872897e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:29.402423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70049-c084-42f7-9a97-ee7872897e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:29.404924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70049-c084-42f7-9a97-ee7872897e55 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:29.416661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1245/2481] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:45:29.421123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb2854-160b-4b49-9874-a834c8846bb7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:29.431989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb2854-160b-4b49-9874-a834c8846bb7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:29.437795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:29.438500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:29.438778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:29.439051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] PATH_INFO: `/v3/projects/3aae8105b1e440e7873e5ee2dfa14c93/users/076dc430ffdf44aba8eb012f53434a01/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:29.456030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aae8105b1e440e7873e5ee2dfa14c93, user_id=076dc430ffdf44aba8eb012f53434a01, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:29.458724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:29.536359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1237/2482] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:45:29 2022] PUT /identity/v3/projects/3aae8105b1e440e7873e5ee2dfa14c93/users/076dc430ffdf44aba8eb012f53434a01/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:45:29.541660 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dcd31-6169-4064-87e7-d178230017d3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:29.541954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dcd31-6169-4064-87e7-d178230017d3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:29.542347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dcd31-6169-4064-87e7-d178230017d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:29.565180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d80dcd31-6169-4064-87e7-d178230017d3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:29.566457 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d80dcd31-6169-4064-87e7-d178230017d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:29.590630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:29.643443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1246/2483] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:45:29.653067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:29.657367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:29.696383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:29.727922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deecb9-e379-421d-9628-9cca3c320cb5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:29.733844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:29.734518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:29.735017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:29.735293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:29.745460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:29.746918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:29.758157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1238/2484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:33.688446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892ca90-40de-473d-af37-161d7d74c61c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:33.688880 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892ca90-40de-473d-af37-161d7d74c61c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:33.688990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892ca90-40de-473d-af37-161d7d74c61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:33.717311 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4892ca90-40de-473d-af37-161d7d74c61c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:33.719225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4892ca90-40de-473d-af37-161d7d74c61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:33.730369 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1247/2485] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:33.753141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:33.754560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:33.849690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533a80-4ca2-4cf0-9ded-0cc12ea5618a service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:33.856724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434ce8e-9b7b-4eb6-9d61-69900c10c759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:33.857769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434ce8e-9b7b-4eb6-9d61-69900c10c759 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:33.858167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434ce8e-9b7b-4eb6-9d61-69900c10c759 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:33.858508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434ce8e-9b7b-4eb6-9d61-69900c10c759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:33.868412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434ce8e-9b7b-4eb6-9d61-69900c10c759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:33.871821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434ce8e-9b7b-4eb6-9d61-69900c10c759 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:33.881278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1239/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:38.116722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0ca34-cf0a-406e-bd3c-809d61788fee None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:38.117686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0ca34-cf0a-406e-bd3c-809d61788fee None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:38.118294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0ca34-cf0a-406e-bd3c-809d61788fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:38.142168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-04c0ca34-cf0a-406e-bd3c-809d61788fee None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:38.143532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-04c0ca34-cf0a-406e-bd3c-809d61788fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:38.153772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1248/2487] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:38.170859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434ce8e-9b7b-4eb6-9d61-69900c10c759 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:38.190215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434ce8e-9b7b-4eb6-9d61-69900c10c759 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:38.197110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:38.197789 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:38.198143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:38.198421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:38.210035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:38.212486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:38.234490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1240/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:38.577394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819d2d-e46c-4e4f-8979-2f955a65ff74 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:38.577713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819d2d-e46c-4e4f-8979-2f955a65ff74 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:38.578041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819d2d-e46c-4e4f-8979-2f955a65ff74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:38.607930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-95819d2d-e46c-4e4f-8979-2f955a65ff74 None None] MFA Rules not processed for user `076dc430ffdf44aba8eb012f53434a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:38.609149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-95819d2d-e46c-4e4f-8979-2f955a65ff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:38.693386 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1249/2489] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:45:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:38.702024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:38.703460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:38.731160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874e74-0415-40ad-ad4b-cf2d2e883648 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:38.738129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00dca-6e54-4cb2-9363-eddd7017c3f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:38.738750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00dca-6e54-4cb2-9363-eddd7017c3f2 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:38.739030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00dca-6e54-4cb2-9363-eddd7017c3f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:38.739301 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00dca-6e54-4cb2-9363-eddd7017c3f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:38.748849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e00dca-6e54-4cb2-9363-eddd7017c3f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:38.750530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e00dca-6e54-4cb2-9363-eddd7017c3f2 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:38.766315 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1241/2490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:45:39.659175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95819d2d-e46c-4e4f-8979-2f955a65ff74 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:39.661324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-95819d2d-e46c-4e4f-8979-2f955a65ff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:39.683209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95819d2d-e46c-4e4f-8979-2f955a65ff74 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:39.691435 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:39.692061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:39.692342 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:39.692619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] PATH_INFO: `/v3/users/12b6287f37d9429e873d1ac7dcebe42c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:39.693835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b6287f37d9429e873d1ac7dcebe42c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:39.696034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:39.936942 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b6287f37d9429e873d1ac7dcebe42c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:39.937889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b6287f37d9429e873d1ac7dcebe42c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:39.948786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b6287f37d9429e873d1ac7dcebe42c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:39.994840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b6287f37d9429e873d1ac7dcebe42c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:39.995755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b6287f37d9429e873d1ac7dcebe42c'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:40.081217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1250/2491] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:45:39 2022] DELETE /identity/v3/users/12b6287f37d9429e873d1ac7dcebe42c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:45:40.659067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00dca-6e54-4cb2-9363-eddd7017c3f2 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:40.728489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00dca-6e54-4cb2-9363-eddd7017c3f2 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:40.840121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:40.840907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:40.841313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:40.844226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] PATH_INFO: `/v3/projects/8807b854790f45509c9695ae7193b4ca` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:40.856601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8807b854790f45509c9695ae7193b4ca)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:40.859181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:41.014638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:41.031793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8807b854790f45509c9695ae7193b4ca', 'request_id': 'req-7b99090f-cdc7-47ca-a153-c9a59483e9c8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.095665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8807b854790f45509c9695ae7193b4ca', 'request_id': 'req-7b99090f-cdc7-47ca-a153-c9a59483e9c8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.102114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8807b854790f45509c9695ae7193b4ca', 'request_id': 'req-7b99090f-cdc7-47ca-a153-c9a59483e9c8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.124419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] The token cache is being invalidate because project 8807b854790f45509c9695ae7193b4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:45:41.124887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.125734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7b99090f-cdc7-47ca-a153-c9a59483e9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.131227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1242/2492] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:45:40 2022] DELETE /identity/v3/projects/8807b854790f45509c9695ae7193b4ca => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:45:41.132548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:41.134814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:41.152741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23776-29c4-4cce-9138-f963491f50af admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:41.165952 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:41.228126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:41.232862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:41.236946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:41.236946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] PATH_INFO: `/v3/users/4fb23c33fc30490598421e2526cc4ac8` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:41.236946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb23c33fc30490598421e2526cc4ac8)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:41.237644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:41.443722 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb23c33fc30490598421e2526cc4ac8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.444757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb23c33fc30490598421e2526cc4ac8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.462867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb23c33fc30490598421e2526cc4ac8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.475900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb23c33fc30490598421e2526cc4ac8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.477515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb23c33fc30490598421e2526cc4ac8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:41.574086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1251/2493] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:45:41 2022] DELETE /identity/v3/users/4fb23c33fc30490598421e2526cc4ac8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:45:41.788002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee2e1-ff79-42f7-b073-6aacfc236a42 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:41.788547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee2e1-ff79-42f7-b073-6aacfc236a42 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:41.788547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee2e1-ff79-42f7-b073-6aacfc236a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:41.811705 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9aaee2e1-ff79-42f7-b073-6aacfc236a42 None None] MFA Rules not processed for user `076dc430ffdf44aba8eb012f53434a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:41.813341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9aaee2e1-ff79-42f7-b073-6aacfc236a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:41.879281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1243/2494] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:41.909074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:41.913235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:42.068180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3f217-0b23-40b1-ac5e-56edb2a78cc3 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:42.082905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:42.082905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:42.082905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:42.082905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] PATH_INFO: `/v3/projects/f3f4ab9498554124aebfbe337ef4a033` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:42.089371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f4ab9498554124aebfbe337ef4a033)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:42.090300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:42.178451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd60b-c77d-491f-9b58-af4dd70b8b00 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:42.178945 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd60b-c77d-491f-9b58-af4dd70b8b00 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:42.179397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bd60b-c77d-491f-9b58-af4dd70b8b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:42.217891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-813bd60b-c77d-491f-9b58-af4dd70b8b00 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:42.221647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-813bd60b-c77d-491f-9b58-af4dd70b8b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:42.236656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f4ab9498554124aebfbe337ef4a033', 'request_id': 'req-6458465d-27b1-4aae-8543-f02ab8f04a65'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:42.307113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f4ab9498554124aebfbe337ef4a033', 'request_id': 'req-6458465d-27b1-4aae-8543-f02ab8f04a65'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:42.317372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f4ab9498554124aebfbe337ef4a033', 'request_id': 'req-6458465d-27b1-4aae-8543-f02ab8f04a65'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:42.336902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1244/2495] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:42.338019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bd60b-c77d-491f-9b58-af4dd70b8b00 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:42.339564 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-813bd60b-c77d-491f-9b58-af4dd70b8b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:42.340147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] The token cache is being invalidate because project f3f4ab9498554124aebfbe337ef4a033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:45:42.345773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:42.345773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:45:42.345773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1252/2496] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:45:41 2022] DELETE /identity/v3/projects/f3f4ab9498554124aebfbe337ef4a033 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:45:42.407961 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bd60b-c77d-491f-9b58-af4dd70b8b00 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:42.411884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231c9c-def7-4c85-bb44-b548757c1e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:42.412767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231c9c-def7-4c85-bb44-b548757c1e4e service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:42.412767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231c9c-def7-4c85-bb44-b548757c1e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:42.413082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231c9c-def7-4c85-bb44-b548757c1e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:42.415761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-36231c9c-def7-4c85-bb44-b548757c1e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:42.428269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231c9c-def7-4c85-bb44-b548757c1e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:42.429734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231c9c-def7-4c85-bb44-b548757c1e4e service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:42.440535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1245/2497] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:42.613873 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:42.615411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:42.699241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458465d-27b1-4aae-8543-f02ab8f04a65 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:42.708176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:42.708176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:42.708176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:42.708176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:42.709321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:42.721485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:42.723206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:42.734497 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1253/2498] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:42.970095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:47.700704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ca74-13e0-4a1d-9072-ec7bee9fed93 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:47.701278 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ca74-13e0-4a1d-9072-ec7bee9fed93 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:47.701459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ca74-13e0-4a1d-9072-ec7bee9fed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:47.744757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2678ca74-13e0-4a1d-9072-ec7bee9fed93 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:47.747286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2678ca74-13e0-4a1d-9072-ec7bee9fed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:47.775862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1246/2499] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:47.800161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:47.815656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8263c-8397-48a2-b818-5b4f2a3296d5 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:47.823954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02cb0-93e8-431c-b0d4-1e283cb2c50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:47.825229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02cb0-93e8-431c-b0d4-1e283cb2c50a service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:47.825576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02cb0-93e8-431c-b0d4-1e283cb2c50a service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:47.826142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02cb0-93e8-431c-b0d4-1e283cb2c50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:47.841364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02cb0-93e8-431c-b0d4-1e283cb2c50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:47.841364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02cb0-93e8-431c-b0d4-1e283cb2c50a service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:47.853959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1254/2500] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:50.952901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9b1fa-20bb-439c-85c0-3f04f9b6a4c2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:50.953613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9b1fa-20bb-439c-85c0-3f04f9b6a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:50.954316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9b1fa-20bb-439c-85c0-3f04f9b6a4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:50.970104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:45:50.990587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e4e9b1fa-20bb-439c-85c0-3f04f9b6a4c2 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:45:50.992688 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e4e9b1fa-20bb-439c-85c0-3f04f9b6a4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:51.007211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1247/2501] 10.222.0.60 () {58 vars in 1016 bytes} [Thu Sep 22 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:45:51.023842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02cb0-93e8-431c-b0d4-1e283cb2c50a service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:51.036307 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02cb0-93e8-431c-b0d4-1e283cb2c50a service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:51.042389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9fa20-d67d-41b5-93fd-f7ffb63beb3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:51.043380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fa20-d67d-41b5-93fd-f7ffb63beb3b service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:51.043380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fa20-d67d-41b5-93fd-f7ffb63beb3b service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:51.043692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9fa20-d67d-41b5-93fd-f7ffb63beb3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:51.053949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9fa20-d67d-41b5-93fd-f7ffb63beb3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:51.056068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9fa20-d67d-41b5-93fd-f7ffb63beb3b service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:51.068524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1255/2502] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:45:55.265374 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9b1fa-20bb-439c-85c0-3f04f9b6a4c2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:55.266992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e4e9b1fa-20bb-439c-85c0-3f04f9b6a4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:55.282917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9b1fa-20bb-439c-85c0-3f04f9b6a4c2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:55.286670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:55.287322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:55.287601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:55.287873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:55.289593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:55.301526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:55.303049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:55.313501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1248/2503] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:45:55.936898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9fa20-d67d-41b5-93fd-f7ffb63beb3b service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:55.960347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9fa20-d67d-41b5-93fd-f7ffb63beb3b service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:55.970861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:55.971946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:55.972546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:55.973127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:55.976024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:55.995036 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:55.996709 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:45:56.007705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1256/2504] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:45:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:45:59.879226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:45:59.880795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:45:59.894903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8986a-645a-4575-ad0f-3e5b9ea93757 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:45:59.899969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:45:59.902003 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:45:59.902292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:45:59.902566 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] PATH_INFO: `/v3/users/e31c29dd5cbb4ede8989904bfe4416ae` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:45:59.904159 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31c29dd5cbb4ede8989904bfe4416ae)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:45:59.905948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:00.120570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31c29dd5cbb4ede8989904bfe4416ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:00.134440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31c29dd5cbb4ede8989904bfe4416ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:00.245953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31c29dd5cbb4ede8989904bfe4416ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:00.247987 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31c29dd5cbb4ede8989904bfe4416ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:00.259662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31c29dd5cbb4ede8989904bfe4416ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:00.278963 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1249/2505] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:45:59 2022] DELETE /identity/v3/users/e31c29dd5cbb4ede8989904bfe4416ae => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:00.315799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:00.317302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:00.334712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb7609-8792-4876-9280-d3f31abc3f99 service nova] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:00.453426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6b1ce-7f03-42ba-b5e1-81da0c2df102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:00.454555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b1ce-7f03-42ba-b5e1-81da0c2df102 service nova] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:00.455765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b1ce-7f03-42ba-b5e1-81da0c2df102 service nova] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:00.456444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b1ce-7f03-42ba-b5e1-81da0c2df102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:00.459609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a3e6b1ce-7f03-42ba-b5e1-81da0c2df102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:00.474831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:00.478189 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6b1ce-7f03-42ba-b5e1-81da0c2df102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:00.481112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6b1ce-7f03-42ba-b5e1-81da0c2df102 service nova] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:00.501916 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1257/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:00.652958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:00.657844 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:00.851348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789365-0a5c-4e97-a4d2-cb3e1170672b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:00.860848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:00.868044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:00.868044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:00.868044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] PATH_INFO: `/v3/projects/1393fa02f09e4198aee55d19d4165c05` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:00.872013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1393fa02f09e4198aee55d19d4165c05)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:00.874745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:01.070918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1393fa02f09e4198aee55d19d4165c05', 'request_id': 'req-017eb766-a047-43e7-9a4d-ec043c210c1d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:01.169943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1393fa02f09e4198aee55d19d4165c05', 'request_id': 'req-017eb766-a047-43e7-9a4d-ec043c210c1d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:01.171605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:01.178093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1393fa02f09e4198aee55d19d4165c05', 'request_id': 'req-017eb766-a047-43e7-9a4d-ec043c210c1d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:01.205419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] The token cache is being invalidate because project 1393fa02f09e4198aee55d19d4165c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:01.205711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:01.206595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017eb766-a047-43e7-9a4d-ec043c210c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:01.208412 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1250/2507] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:00 2022] DELETE /identity/v3/projects/1393fa02f09e4198aee55d19d4165c05 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:01.213564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf470e8-4d97-4486-9b6c-2993efa4cfa2 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.213843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf470e8-4d97-4486-9b6c-2993efa4cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.214147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf470e8-4d97-4486-9b6c-2993efa4cfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.247453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5bf470e8-4d97-4486-9b6c-2993efa4cfa2 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:01.248799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5bf470e8-4d97-4486-9b6c-2993efa4cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:01.333267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1258/2508] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:01.341956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988461c3-b343-4abd-a159-e5045934d122 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.342279 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988461c3-b343-4abd-a159-e5045934d122 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.342549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988461c3-b343-4abd-a159-e5045934d122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.365924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-988461c3-b343-4abd-a159-e5045934d122 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:01.367639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-988461c3-b343-4abd-a159-e5045934d122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:01.380334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1251/2509] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:01.384247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf470e8-4d97-4486-9b6c-2993efa4cfa2 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:01.396490 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf470e8-4d97-4486-9b6c-2993efa4cfa2 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:01.401631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:01.402380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.402608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.402879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.403603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:46:01.403949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:01.405911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:01.418655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1259/2510] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:46:01.426996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988461c3-b343-4abd-a159-e5045934d122 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:01.437539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988461c3-b343-4abd-a159-e5045934d122 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:01.446167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2338-db18-4ba1-bd3f-322b6b2820e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:01.447163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2338-db18-4ba1-bd3f-322b6b2820e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.447435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2338-db18-4ba1-bd3f-322b6b2820e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.447699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2338-db18-4ba1-bd3f-322b6b2820e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.448340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2338-db18-4ba1-bd3f-322b6b2820e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:01.450902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2338-db18-4ba1-bd3f-322b6b2820e7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:01.538737 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1252/2511] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:01 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:01.543170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:01.554938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a5770-7967-4030-a8df-9de0030af82f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:01.627897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caca7e2-4ce5-4123-a66d-0cb0247afd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:01.628646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caca7e2-4ce5-4123-a66d-0cb0247afd98 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.629014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caca7e2-4ce5-4123-a66d-0cb0247afd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.629364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caca7e2-4ce5-4123-a66d-0cb0247afd98 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.630123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caca7e2-4ce5-4123-a66d-0cb0247afd98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:01.632172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caca7e2-4ce5-4123-a66d-0cb0247afd98 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:01.753088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1260/2512] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:01 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:01.757384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2338-db18-4ba1-bd3f-322b6b2820e7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:01.769450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2338-db18-4ba1-bd3f-322b6b2820e7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:01.775294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2ecd-d9ae-4d7a-8ca8-2af7cc3237c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:01.775294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2ecd-d9ae-4d7a-8ca8-2af7cc3237c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.775603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2ecd-d9ae-4d7a-8ca8-2af7cc3237c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.775936 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2ecd-d9ae-4d7a-8ca8-2af7cc3237c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.776647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa2ecd-d9ae-4d7a-8ca8-2af7cc3237c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:01.779220 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa2ecd-d9ae-4d7a-8ca8-2af7cc3237c5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:01.790325 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1253/2513] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:46:01.794749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caca7e2-4ce5-4123-a66d-0cb0247afd98 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:01.805150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caca7e2-4ce5-4123-a66d-0cb0247afd98 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:01.809850 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e96fa-7bd0-4ac2-8129-c76e7dc89623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:01.810568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e96fa-7bd0-4ac2-8129-c76e7dc89623 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.810843 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e96fa-7bd0-4ac2-8129-c76e7dc89623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.811114 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e96fa-7bd0-4ac2-8129-c76e7dc89623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.812048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e96fa-7bd0-4ac2-8129-c76e7dc89623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:01.813634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e96fa-7bd0-4ac2-8129-c76e7dc89623 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:01.829389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1261/2514] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:01.833714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2ecd-d9ae-4d7a-8ca8-2af7cc3237c5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:01.845563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2ecd-d9ae-4d7a-8ca8-2af7cc3237c5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:01.850461 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:01.851124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.851403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.851676 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] PATH_INFO: `/v3/projects/791ea35cdc164fa5bd4e29e10f82cb6a/users/04db2a63e28542e591eff5f4d46d375b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.867349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=791ea35cdc164fa5bd4e29e10f82cb6a, user_id=04db2a63e28542e591eff5f4d46d375b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:01.870077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:01.945475 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1254/2515] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:01 2022] PUT /identity/v3/projects/791ea35cdc164fa5bd4e29e10f82cb6a/users/04db2a63e28542e591eff5f4d46d375b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:46:01.953406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20bc81-44da-41a4-9c61-bc61fa6fd029 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:01.953690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20bc81-44da-41a4-9c61-bc61fa6fd029 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:01.953997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20bc81-44da-41a4-9c61-bc61fa6fd029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:01.985179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ee20bc81-44da-41a4-9c61-bc61fa6fd029 None None] MFA Rules not processed for user `04db2a63e28542e591eff5f4d46d375b`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:01.986586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ee20bc81-44da-41a4-9c61-bc61fa6fd029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:02.043448 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:02.064040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1262/2516] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:02.076780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:02.079307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:02.116603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddcca6-55b2-4d14-8b49-e2ad5bbcc0f9 None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:02.116881 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddcca6-55b2-4d14-8b49-e2ad5bbcc0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:02.117179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddcca6-55b2-4d14-8b49-e2ad5bbcc0f9 None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:02.118641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1263/2517] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 22 14:46:02.126679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f858-9119-4ef3-8b32-e9cf58b25b40 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:02.126679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f858-9119-4ef3-8b32-e9cf58b25b40 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:02.126679 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309f858-9119-4ef3-8b32-e9cf58b25b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:02.155272 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-b309f858-9119-4ef3-8b32-e9cf58b25b40 None None] MFA Rules not processed for user `75252b7cba4943b2874983d1a83a9175`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:02.156839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-b309f858-9119-4ef3-8b32-e9cf58b25b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:02.177371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5aca1-c3f1-49d5-a9b9-a1bbfce555cf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:02.183361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:02.184039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:02.184316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:02.185127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:02.202013 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:02.203804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:02.216951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1255/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:02.230225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1264/2519] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:46:02.241224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:02.243100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:02.256164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de683f-9b4e-4737-aae6-2934ab0acb04 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:02.260004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b1583-8b87-488b-9cc3-faefd21a0a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:02.260697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1583-8b87-488b-9cc3-faefd21a0a45 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:02.262270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1583-8b87-488b-9cc3-faefd21a0a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:02.262270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1583-8b87-488b-9cc3-faefd21a0a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:02.270314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b1583-8b87-488b-9cc3-faefd21a0a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:02.271749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b1583-8b87-488b-9cc3-faefd21a0a45 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:02.280664 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1256/2520] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:46:02.365456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280eb30e-ca0f-41fa-abab-55b716cf57fb None None] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:02.366003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280eb30e-ca0f-41fa-abab-55b716cf57fb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:02.366003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280eb30e-ca0f-41fa-abab-55b716cf57fb None None] PATH_INFO: `/` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:02.368041 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1265/2521] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 22 14:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 22 14:46:02.373809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98539c-3816-42ce-b944-972863a262ba None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:02.374123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98539c-3816-42ce-b944-972863a262ba None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:02.374398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98539c-3816-42ce-b944-972863a262ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:02.394900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6d98539c-3816-42ce-b944-972863a262ba None None] MFA Rules not processed for user `6bc75cc7beb54ef2abd4876b2b35675e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:02.396113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6d98539c-3816-42ce-b944-972863a262ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:02.406105 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1257/2522] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 22 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:02.417237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280eb30e-ca0f-41fa-abab-55b716cf57fb None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:02.419115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-280eb30e-ca0f-41fa-abab-55b716cf57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:02.432653 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280eb30e-ca0f-41fa-abab-55b716cf57fb None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:02.437169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9beb73-5aee-4ce4-a21a-4c35c91ca974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:02.437909 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9beb73-5aee-4ce4-a21a-4c35c91ca974 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:02.438242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9beb73-5aee-4ce4-a21a-4c35c91ca974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:02.438510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9beb73-5aee-4ce4-a21a-4c35c91ca974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:02.449425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9beb73-5aee-4ce4-a21a-4c35c91ca974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:02.451554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9beb73-5aee-4ce4-a21a-4c35c91ca974 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:02.463324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1266/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:05.501339 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98539c-3816-42ce-b944-972863a262ba None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:05.544886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:05.559149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98539c-3816-42ce-b944-972863a262ba None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:05.564221 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:05.564849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:05.565128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:05.565404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] PATH_INFO: `/v3/users/04db2a63e28542e591eff5f4d46d375b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:05.566550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04db2a63e28542e591eff5f4d46d375b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:05.568509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:05.768075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04db2a63e28542e591eff5f4d46d375b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:05.781780 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04db2a63e28542e591eff5f4d46d375b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:05.878438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04db2a63e28542e591eff5f4d46d375b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:05.879103 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04db2a63e28542e591eff5f4d46d375b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:05.886859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04db2a63e28542e591eff5f4d46d375b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:05.893500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1258/2524] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:05 2022] DELETE /identity/v3/users/04db2a63e28542e591eff5f4d46d375b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:05.898042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677c18-0478-4f10-a6eb-9ca4923935fc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:05.898557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677c18-0478-4f10-a6eb-9ca4923935fc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:05.898715 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677c18-0478-4f10-a6eb-9ca4923935fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:05.919014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3c677c18-0478-4f10-a6eb-9ca4923935fc None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:05.920406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3c677c18-0478-4f10-a6eb-9ca4923935fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:05.982636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1267/2525] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:05.992560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:05.994274 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:06.057468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c663ff4-9d5f-46a7-a9e1-def956c9905a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:06.063229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60932a-9e0a-4821-8992-17860d5d0b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:06.063854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60932a-9e0a-4821-8992-17860d5d0b46 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:06.064419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60932a-9e0a-4821-8992-17860d5d0b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:06.064695 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60932a-9e0a-4821-8992-17860d5d0b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:06.076704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60932a-9e0a-4821-8992-17860d5d0b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:06.078222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60932a-9e0a-4821-8992-17860d5d0b46 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:06.092440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1259/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:06.670413 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677c18-0478-4f10-a6eb-9ca4923935fc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:06.672053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3c677c18-0478-4f10-a6eb-9ca4923935fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:06.697154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677c18-0478-4f10-a6eb-9ca4923935fc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:06.707747 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:06.708556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:06.708913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:06.709244 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] PATH_INFO: `/v3/projects/791ea35cdc164fa5bd4e29e10f82cb6a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:06.710423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791ea35cdc164fa5bd4e29e10f82cb6a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:06.712335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:06.851785 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791ea35cdc164fa5bd4e29e10f82cb6a', 'request_id': 'req-25603d86-3165-4002-b57f-9cdb433ab597'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:06.947633 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791ea35cdc164fa5bd4e29e10f82cb6a', 'request_id': 'req-25603d86-3165-4002-b57f-9cdb433ab597'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:06.958948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791ea35cdc164fa5bd4e29e10f82cb6a', 'request_id': 'req-25603d86-3165-4002-b57f-9cdb433ab597'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:06.982957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] The token cache is being invalidate because project 791ea35cdc164fa5bd4e29e10f82cb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:06.984656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:06.985562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25603d86-3165-4002-b57f-9cdb433ab597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:06.987312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1268/2527] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:06 2022] DELETE /identity/v3/projects/791ea35cdc164fa5bd4e29e10f82cb6a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:06.992291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de070ce1-6d6a-47d6-abb7-d75994edae63 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:06.992778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de070ce1-6d6a-47d6-abb7-d75994edae63 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:06.992902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de070ce1-6d6a-47d6-abb7-d75994edae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.014563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-de070ce1-6d6a-47d6-abb7-d75994edae63 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:07.016130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-de070ce1-6d6a-47d6-abb7-d75994edae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:07.089526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1260/2528] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:07.103627 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a36d2-01e5-42c3-a226-df4e3b3397c0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.103918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a36d2-01e5-42c3-a226-df4e3b3397c0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.104312 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a36d2-01e5-42c3-a226-df4e3b3397c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.136147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-8f8a36d2-01e5-42c3-a226-df4e3b3397c0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:07.137586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8f8a36d2-01e5-42c3-a226-df4e3b3397c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:07.154045 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1269/2529] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:07.156885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de070ce1-6d6a-47d6-abb7-d75994edae63 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:07.183731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de070ce1-6d6a-47d6-abb7-d75994edae63 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:07.193694 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:07.196198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.196198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.196198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.196500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:46:07.196609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:07.198297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:07.204797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:07.222653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1261/2530] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:46:07.225191 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a36d2-01e5-42c3-a226-df4e3b3397c0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:07.234169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:07.240043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a36d2-01e5-42c3-a226-df4e3b3397c0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:07.249733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290bf51-83e2-48b7-9e36-01cce8d244df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:07.250551 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290bf51-83e2-48b7-9e36-01cce8d244df admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.250977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290bf51-83e2-48b7-9e36-01cce8d244df admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.251588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290bf51-83e2-48b7-9e36-01cce8d244df admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.252201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290bf51-83e2-48b7-9e36-01cce8d244df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:07.254499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290bf51-83e2-48b7-9e36-01cce8d244df admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:07.346168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1270/2531] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:07 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:07.347281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:07.358451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17725d5-f2cc-489d-817a-665f374eae3e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:07.419860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84889863-3676-489f-9fc8-a54120d5aefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:07.420471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889863-3676-489f-9fc8-a54120d5aefc admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.420751 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889863-3676-489f-9fc8-a54120d5aefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.421023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889863-3676-489f-9fc8-a54120d5aefc admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.421671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84889863-3676-489f-9fc8-a54120d5aefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:07.423955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84889863-3676-489f-9fc8-a54120d5aefc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:07.532255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1262/2532] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:07 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:07.543106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290bf51-83e2-48b7-9e36-01cce8d244df admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:07.548315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290bf51-83e2-48b7-9e36-01cce8d244df admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:07.553303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920ce36-850a-4e00-8d75-fd902afbe2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:07.554119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920ce36-850a-4e00-8d75-fd902afbe2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.554469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920ce36-850a-4e00-8d75-fd902afbe2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.554761 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920ce36-850a-4e00-8d75-fd902afbe2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.555418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920ce36-850a-4e00-8d75-fd902afbe2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:07.557267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920ce36-850a-4e00-8d75-fd902afbe2b9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:07.570545 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1271/2533] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:07.574868 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84889863-3676-489f-9fc8-a54120d5aefc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:07.585181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84889863-3676-489f-9fc8-a54120d5aefc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:07.589916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332adaac-e395-4831-938a-c1662f1aa2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:07.591067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332adaac-e395-4831-938a-c1662f1aa2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.591530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332adaac-e395-4831-938a-c1662f1aa2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.591837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332adaac-e395-4831-938a-c1662f1aa2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.592596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332adaac-e395-4831-938a-c1662f1aa2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:07.594216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332adaac-e395-4831-938a-c1662f1aa2ac admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:07.605067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1263/2534] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:46:07.610349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920ce36-850a-4e00-8d75-fd902afbe2b9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:07.620542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920ce36-850a-4e00-8d75-fd902afbe2b9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:07.625525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4170e-7460-41d9-8a30-544acf712f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:07.626220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4170e-7460-41d9-8a30-544acf712f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.626509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4170e-7460-41d9-8a30-544acf712f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.626784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4170e-7460-41d9-8a30-544acf712f38 admin admin] PATH_INFO: `/v3/projects/08d95205edb84cf79f99fd75e80258d2/users/41f53a646c55499bac70aad72a4bff01/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.643396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4170e-7460-41d9-8a30-544acf712f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d95205edb84cf79f99fd75e80258d2, user_id=41f53a646c55499bac70aad72a4bff01, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:07.646352 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4170e-7460-41d9-8a30-544acf712f38 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:07.746634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1272/2535] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:07 2022] PUT /identity/v3/projects/08d95205edb84cf79f99fd75e80258d2/users/41f53a646c55499bac70aad72a4bff01/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:07.758976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb98d8-20ac-4db4-9b8a-734fedea50da None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.759280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb98d8-20ac-4db4-9b8a-734fedea50da None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.759579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb98d8-20ac-4db4-9b8a-734fedea50da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.789717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-84bb98d8-20ac-4db4-9b8a-734fedea50da None None] MFA Rules not processed for user `41f53a646c55499bac70aad72a4bff01`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:07.791331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-84bb98d8-20ac-4db4-9b8a-734fedea50da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:07.862294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1264/2536] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:46:07.866954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4170e-7460-41d9-8a30-544acf712f38 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:07.930817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4170e-7460-41d9-8a30-544acf712f38 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:07.939242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba485e6-c9d8-4a9e-bf4e-abb03405af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:07.939878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba485e6-c9d8-4a9e-bf4e-abb03405af3c admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:07.940164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba485e6-c9d8-4a9e-bf4e-abb03405af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:07.940439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba485e6-c9d8-4a9e-bf4e-abb03405af3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:07.941123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba485e6-c9d8-4a9e-bf4e-abb03405af3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:07.943117 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba485e6-c9d8-4a9e-bf4e-abb03405af3c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:08.036764 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1273/2537] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:07 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:08.041431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb98d8-20ac-4db4-9b8a-734fedea50da None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:08.056073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb98d8-20ac-4db4-9b8a-734fedea50da None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:08.124598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1478d-a057-4b47-9b81-76362566e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:08.125212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1478d-a057-4b47-9b81-76362566e531 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:08.125494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1478d-a057-4b47-9b81-76362566e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:08.125762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1478d-a057-4b47-9b81-76362566e531 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:08.126433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1478d-a057-4b47-9b81-76362566e531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:08.128478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1478d-a057-4b47-9b81-76362566e531 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:08.240055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1265/2538] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:08 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:08.244278 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba485e6-c9d8-4a9e-bf4e-abb03405af3c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:08.255206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba485e6-c9d8-4a9e-bf4e-abb03405af3c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:08.260692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac324c-5cd1-42b4-88ae-8f5b4963dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:08.261322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac324c-5cd1-42b4-88ae-8f5b4963dc97 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:08.261783 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac324c-5cd1-42b4-88ae-8f5b4963dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:08.262106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac324c-5cd1-42b4-88ae-8f5b4963dc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:08.262769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac324c-5cd1-42b4-88ae-8f5b4963dc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:08.264412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac324c-5cd1-42b4-88ae-8f5b4963dc97 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:08.275327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1274/2539] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:08.280687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1478d-a057-4b47-9b81-76362566e531 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:08.290866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1478d-a057-4b47-9b81-76362566e531 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:08.297142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6272-4c05-4339-9552-239d683fb406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:08.300560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6272-4c05-4339-9552-239d683fb406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:08.300560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6272-4c05-4339-9552-239d683fb406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:08.300560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd6272-4c05-4339-9552-239d683fb406 admin admin] PATH_INFO: `/v3/projects/b3bf3d2006244c1fa919cd3f8dd0ecae/users/f3c8218a1dfb4d028a600e38975f747b/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:08.315189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd6272-4c05-4339-9552-239d683fb406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bf3d2006244c1fa919cd3f8dd0ecae, user_id=f3c8218a1dfb4d028a600e38975f747b, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:08.318077 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd6272-4c05-4339-9552-239d683fb406 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:08.408658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1266/2540] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:08 2022] PUT /identity/v3/projects/b3bf3d2006244c1fa919cd3f8dd0ecae/users/f3c8218a1dfb4d028a600e38975f747b/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:46:08.414513 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac324c-5cd1-42b4-88ae-8f5b4963dc97 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:08.429445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac324c-5cd1-42b4-88ae-8f5b4963dc97 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:08.501544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247525f0-9030-4ef2-9041-28367d9f2683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:08.502223 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247525f0-9030-4ef2-9041-28367d9f2683 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:08.506706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247525f0-9030-4ef2-9041-28367d9f2683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:08.506706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247525f0-9030-4ef2-9041-28367d9f2683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:08.506706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247525f0-9030-4ef2-9041-28367d9f2683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:08.506706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247525f0-9030-4ef2-9041-28367d9f2683 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:08.520210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1275/2541] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:08.521650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6272-4c05-4339-9552-239d683fb406 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:08.534425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd6272-4c05-4339-9552-239d683fb406 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:08.540975 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:08.547472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:08.547472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:08.547472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] PATH_INFO: `/v3/projects/b3bf3d2006244c1fa919cd3f8dd0ecae/users/f3c8218a1dfb4d028a600e38975f747b/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:08.547472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3bf3d2006244c1fa919cd3f8dd0ecae, user_id=f3c8218a1dfb4d028a600e38975f747b, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:08.547849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:08.558808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1267/2542] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:08 2022] PUT /identity/v3/projects/b3bf3d2006244c1fa919cd3f8dd0ecae/users/f3c8218a1dfb4d028a600e38975f747b/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:08.573321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eaddc-a93b-444d-bb4d-d35f42182483 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:08.573538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eaddc-a93b-444d-bb4d-d35f42182483 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:08.573790 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eaddc-a93b-444d-bb4d-d35f42182483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:08.602794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-fb0eaddc-a93b-444d-bb4d-d35f42182483 None None] MFA Rules not processed for user `f3c8218a1dfb4d028a600e38975f747b`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:08.604033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-fb0eaddc-a93b-444d-bb4d-d35f42182483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:08.660427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:08.672510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1276/2543] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:08.683329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:08.684400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:08.687180 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:08.746361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ab6a-68ca-4917-9444-6c2b53181fb4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:08.750154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f383ff2-5ccc-4d34-9014-1f7880afbfe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:08.750760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f383ff2-5ccc-4d34-9014-1f7880afbfe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:08.751039 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f383ff2-5ccc-4d34-9014-1f7880afbfe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:08.751324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f383ff2-5ccc-4d34-9014-1f7880afbfe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:08.760287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f383ff2-5ccc-4d34-9014-1f7880afbfe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:08.761702 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f383ff2-5ccc-4d34-9014-1f7880afbfe5 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:08.772019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1268/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:08.802743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eaddc-a93b-444d-bb4d-d35f42182483 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:08.869629 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eaddc-a93b-444d-bb4d-d35f42182483 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:08.876314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:08.877260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:08.878236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:08.878236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] PATH_INFO: `/v3/users/41f53a646c55499bac70aad72a4bff01` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:08.879919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f53a646c55499bac70aad72a4bff01)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:08.882058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:09.052970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f53a646c55499bac70aad72a4bff01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:09.054068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f53a646c55499bac70aad72a4bff01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:09.062917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f53a646c55499bac70aad72a4bff01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:09.077303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f53a646c55499bac70aad72a4bff01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:09.078098 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f53a646c55499bac70aad72a4bff01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:09.168727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1277/2545] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:08 2022] DELETE /identity/v3/users/41f53a646c55499bac70aad72a4bff01 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:09.173559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2b089-b8f8-4fd5-b878-843ba3af63b1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:09.174074 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2b089-b8f8-4fd5-b878-843ba3af63b1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:09.174202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2b089-b8f8-4fd5-b878-843ba3af63b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:09.193890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6bd2b089-b8f8-4fd5-b878-843ba3af63b1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:09.195119 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6bd2b089-b8f8-4fd5-b878-843ba3af63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:09.269336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1269/2546] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:46:09.280297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:09.281833 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:09.312147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:09.343905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e58798-7b6a-47bd-b746-cf2bc1dc6f42 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:09.348354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd791d-d1df-443e-8196-08f3a2d25ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:09.348970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd791d-d1df-443e-8196-08f3a2d25ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:09.349246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd791d-d1df-443e-8196-08f3a2d25ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:09.349515 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd791d-d1df-443e-8196-08f3a2d25ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:09.362219 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd791d-d1df-443e-8196-08f3a2d25ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:09.362518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd791d-d1df-443e-8196-08f3a2d25ba3 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:09.373394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1278/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:09.839830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2b089-b8f8-4fd5-b878-843ba3af63b1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:09.841781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6bd2b089-b8f8-4fd5-b878-843ba3af63b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:09.853830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2b089-b8f8-4fd5-b878-843ba3af63b1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:09.859247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:09.859878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:09.860218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:09.860491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] PATH_INFO: `/v3/projects/08d95205edb84cf79f99fd75e80258d2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:09.861638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d95205edb84cf79f99fd75e80258d2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:09.863653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:09.981462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d95205edb84cf79f99fd75e80258d2', 'request_id': 'req-253bb8af-64d4-4d8c-bd65-9542228585a6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:09.985128 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:10.071626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d95205edb84cf79f99fd75e80258d2', 'request_id': 'req-253bb8af-64d4-4d8c-bd65-9542228585a6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.082215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d95205edb84cf79f99fd75e80258d2', 'request_id': 'req-253bb8af-64d4-4d8c-bd65-9542228585a6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.094014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] The token cache is being invalidate because project 08d95205edb84cf79f99fd75e80258d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:10.094014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.094762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.096256 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1270/2548] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:09 2022] DELETE /identity/v3/projects/08d95205edb84cf79f99fd75e80258d2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:10.100540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd791d-d1df-443e-8196-08f3a2d25ba3 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:10.112487 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd791d-d1df-443e-8196-08f3a2d25ba3 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:10.174340 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:10.175057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:10.175343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:10.175786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] PATH_INFO: `/v3/users/f3c8218a1dfb4d028a600e38975f747b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:10.176979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c8218a1dfb4d028a600e38975f747b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:10.178922 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:10.373566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c8218a1dfb4d028a600e38975f747b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.374206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c8218a1dfb4d028a600e38975f747b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.381516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c8218a1dfb4d028a600e38975f747b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.394458 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c8218a1dfb4d028a600e38975f747b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.395169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-f4a354a9-aa65-489d-9402-74a71a6200e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c8218a1dfb4d028a600e38975f747b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:10.460414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1279/2549] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:10 2022] DELETE /identity/v3/users/f3c8218a1dfb4d028a600e38975f747b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:10.970618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:10.972079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:10.988398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb8af-64d4-4d8c-bd65-9542228585a6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:11.049713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:11.050889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.051170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.051471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] PATH_INFO: `/v3/projects/b3bf3d2006244c1fa919cd3f8dd0ecae` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.052691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3bf3d2006244c1fa919cd3f8dd0ecae)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:11.054615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:11.178684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3bf3d2006244c1fa919cd3f8dd0ecae', 'request_id': 'req-f70463a8-af53-43ef-995a-5c01674f5645'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:11.249087 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3bf3d2006244c1fa919cd3f8dd0ecae', 'request_id': 'req-f70463a8-af53-43ef-995a-5c01674f5645'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:11.255575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3bf3d2006244c1fa919cd3f8dd0ecae', 'request_id': 'req-f70463a8-af53-43ef-995a-5c01674f5645'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:11.268137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] The token cache is being invalidate because project b3bf3d2006244c1fa919cd3f8dd0ecae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:11.268433 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:11.269381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f70463a8-af53-43ef-995a-5c01674f5645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:11.270962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1271/2550] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:10 2022] DELETE /identity/v3/projects/b3bf3d2006244c1fa919cd3f8dd0ecae => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:11.275998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6035e4-00a1-4570-9629-30f7e27f9a92 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.276505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6035e4-00a1-4570-9629-30f7e27f9a92 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.276505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6035e4-00a1-4570-9629-30f7e27f9a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.297898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-cf6035e4-00a1-4570-9629-30f7e27f9a92 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:11.302158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cf6035e4-00a1-4570-9629-30f7e27f9a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:11.342364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:11.362449 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1280/2551] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:11.371318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcda0-5f2a-4e8c-8edb-5aef4ad0daa7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.371607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcda0-5f2a-4e8c-8edb-5aef4ad0daa7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.372413 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fcda0-5f2a-4e8c-8edb-5aef4ad0daa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.395876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4a8fcda0-5f2a-4e8c-8edb-5aef4ad0daa7 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:11.397104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4a8fcda0-5f2a-4e8c-8edb-5aef4ad0daa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:11.406639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1272/2552] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:11.411203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6035e4-00a1-4570-9629-30f7e27f9a92 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:11.421607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6035e4-00a1-4570-9629-30f7e27f9a92 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:11.426197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:11.426788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.427060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.427329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.427969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:46:11.428265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:11.429952 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:11.442371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1281/2553] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:46:11.446772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fcda0-5f2a-4e8c-8edb-5aef4ad0daa7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:11.456645 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fcda0-5f2a-4e8c-8edb-5aef4ad0daa7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:11.461400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72f5a-56a6-4003-9923-6fdf81f4a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:11.462018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72f5a-56a6-4003-9923-6fdf81f4a030 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.462293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72f5a-56a6-4003-9923-6fdf81f4a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.462562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa72f5a-56a6-4003-9923-6fdf81f4a030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.463184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72f5a-56a6-4003-9923-6fdf81f4a030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:11.465134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa72f5a-56a6-4003-9923-6fdf81f4a030 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:11.575790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1273/2554] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:11 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:11.580347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:11.595022 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f74a1-dac5-4105-92fc-a7ba171eb778 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:11.661595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918186e-a5e9-450f-b119-444dc14b97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:11.662227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918186e-a5e9-450f-b119-444dc14b97ab admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.662505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918186e-a5e9-450f-b119-444dc14b97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.662772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918186e-a5e9-450f-b119-444dc14b97ab admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.663417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918186e-a5e9-450f-b119-444dc14b97ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:11.665297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918186e-a5e9-450f-b119-444dc14b97ab admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:11.789395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1282/2555] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:11 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:11.790833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72f5a-56a6-4003-9923-6fdf81f4a030 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:11.815601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa72f5a-56a6-4003-9923-6fdf81f4a030 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:11.820809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1d91c-6584-41c9-b518-a4e11ea2a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:11.821509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d91c-6584-41c9-b518-a4e11ea2a650 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.821901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d91c-6584-41c9-b518-a4e11ea2a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.822387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d91c-6584-41c9-b518-a4e11ea2a650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.822939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1d91c-6584-41c9-b518-a4e11ea2a650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:11.824730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1d91c-6584-41c9-b518-a4e11ea2a650 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:11.839287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1274/2556] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:11.842461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918186e-a5e9-450f-b119-444dc14b97ab admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:11.852996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918186e-a5e9-450f-b119-444dc14b97ab admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:11.858986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575faf3-4188-49e4-8d25-0a4c9317dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:11.859594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575faf3-4188-49e4-8d25-0a4c9317dbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.859871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575faf3-4188-49e4-8d25-0a4c9317dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.860148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575faf3-4188-49e4-8d25-0a4c9317dbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.860782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575faf3-4188-49e4-8d25-0a4c9317dbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:11.862455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575faf3-4188-49e4-8d25-0a4c9317dbb9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:11.877930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1283/2557] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:11.879237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1d91c-6584-41c9-b518-a4e11ea2a650 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:11.892084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1d91c-6584-41c9-b518-a4e11ea2a650 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:11.899834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1da45-87df-4488-9676-6afffe73ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:11.900781 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1da45-87df-4488-9676-6afffe73ed01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:11.901191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1da45-87df-4488-9676-6afffe73ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:11.901761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1da45-87df-4488-9676-6afffe73ed01 admin admin] PATH_INFO: `/v3/projects/43fe15bb50d6458996f3c8468e861bf7/users/5075a69eebba420f9433751f0c150e11/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:11.922309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1da45-87df-4488-9676-6afffe73ed01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fe15bb50d6458996f3c8468e861bf7, user_id=5075a69eebba420f9433751f0c150e11, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:11.927472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1da45-87df-4488-9676-6afffe73ed01 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:12.055079 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1275/2558] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:11 2022] PUT /identity/v3/projects/43fe15bb50d6458996f3c8468e861bf7/users/5075a69eebba420f9433751f0c150e11/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:12.066095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd9ac-05f7-4251-95d5-a1f70690634e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.066489 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd9ac-05f7-4251-95d5-a1f70690634e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.066762 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dd9ac-05f7-4251-95d5-a1f70690634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.096976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-004dd9ac-05f7-4251-95d5-a1f70690634e None None] MFA Rules not processed for user `5075a69eebba420f9433751f0c150e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:12.098227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-004dd9ac-05f7-4251-95d5-a1f70690634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:12.166480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1284/2559] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:12.171690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1da45-87df-4488-9676-6afffe73ed01 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:12.181678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:12.232784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1da45-87df-4488-9676-6afffe73ed01 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:12.237444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5da9d9-7759-4468-8800-aa8bb7afda6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:12.238069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5da9d9-7759-4468-8800-aa8bb7afda6a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.238352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5da9d9-7759-4468-8800-aa8bb7afda6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.238621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5da9d9-7759-4468-8800-aa8bb7afda6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.239254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5da9d9-7759-4468-8800-aa8bb7afda6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:12.241193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5da9d9-7759-4468-8800-aa8bb7afda6a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:12.318456 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1276/2560] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:12 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:12.322602 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dd9ac-05f7-4251-95d5-a1f70690634e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:12.333989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dd9ac-05f7-4251-95d5-a1f70690634e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:12.372301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:12.391727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01823ed-ed48-495f-882b-d8f6f209a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:12.392343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01823ed-ed48-495f-882b-d8f6f209a056 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.392619 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01823ed-ed48-495f-882b-d8f6f209a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.392893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01823ed-ed48-495f-882b-d8f6f209a056 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.393565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01823ed-ed48-495f-882b-d8f6f209a056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:12.395587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01823ed-ed48-495f-882b-d8f6f209a056 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:12.485294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1285/2561] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:12 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:12.489100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5da9d9-7759-4468-8800-aa8bb7afda6a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:12.499560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5da9d9-7759-4468-8800-aa8bb7afda6a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:12.504384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f8731-83ea-4834-a4db-8b23406f0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:12.505060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8731-83ea-4834-a4db-8b23406f0ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.505341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8731-83ea-4834-a4db-8b23406f0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.505612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8731-83ea-4834-a4db-8b23406f0ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.506280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f8731-83ea-4834-a4db-8b23406f0ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:12.507859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f8731-83ea-4834-a4db-8b23406f0ca5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:12.519196 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1277/2562] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:12.523556 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01823ed-ed48-495f-882b-d8f6f209a056 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:12.534746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01823ed-ed48-495f-882b-d8f6f209a056 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:12.539537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2609c3-e6b2-4468-82da-eee59a95be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:12.540270 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2609c3-e6b2-4468-82da-eee59a95be24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.540617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2609c3-e6b2-4468-82da-eee59a95be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.540962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2609c3-e6b2-4468-82da-eee59a95be24 admin admin] PATH_INFO: `/v3/projects/bbd7b353605c4061874e3b8aa9d2a2bc/users/1ff9ee853a524e79aeaa525d03777f8f/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.557108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2609c3-e6b2-4468-82da-eee59a95be24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd7b353605c4061874e3b8aa9d2a2bc, user_id=1ff9ee853a524e79aeaa525d03777f8f, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:12.560526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2609c3-e6b2-4468-82da-eee59a95be24 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:12.626436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1286/2563] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:12 2022] PUT /identity/v3/projects/bbd7b353605c4061874e3b8aa9d2a2bc/users/1ff9ee853a524e79aeaa525d03777f8f/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:46:12.630849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f8731-83ea-4834-a4db-8b23406f0ca5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:12.643153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f8731-83ea-4834-a4db-8b23406f0ca5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:12.706472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606d4c3-6a62-4d35-96e9-a5be79e0d97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:12.707085 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606d4c3-6a62-4d35-96e9-a5be79e0d97d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.707372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606d4c3-6a62-4d35-96e9-a5be79e0d97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.707651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606d4c3-6a62-4d35-96e9-a5be79e0d97d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.708293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606d4c3-6a62-4d35-96e9-a5be79e0d97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:12.709903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606d4c3-6a62-4d35-96e9-a5be79e0d97d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:12.720048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1278/2564] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:12.724590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2609c3-e6b2-4468-82da-eee59a95be24 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:12.735297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2609c3-e6b2-4468-82da-eee59a95be24 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:12.740127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:12.740782 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.741060 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.741333 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] PATH_INFO: `/v3/projects/bbd7b353605c4061874e3b8aa9d2a2bc/users/1ff9ee853a524e79aeaa525d03777f8f/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.743322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd7b353605c4061874e3b8aa9d2a2bc, user_id=1ff9ee853a524e79aeaa525d03777f8f, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:12.745919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:12.757407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1287/2565] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:12 2022] PUT /identity/v3/projects/bbd7b353605c4061874e3b8aa9d2a2bc/users/1ff9ee853a524e79aeaa525d03777f8f/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:46:12.769355 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4ad7-b087-416c-a668-c0a32b20a549 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.769681 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4ad7-b087-416c-a668-c0a32b20a549 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.769960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4ad7-b087-416c-a668-c0a32b20a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.800434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-162c4ad7-b087-416c-a668-c0a32b20a549 None None] MFA Rules not processed for user `1ff9ee853a524e79aeaa525d03777f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:12.802104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-162c4ad7-b087-416c-a668-c0a32b20a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:12.874951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1279/2566] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:12.886542 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:12.888991 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:12.956548 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10812c8-7e99-4ddc-9584-89f2b8643a92 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:12.960247 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be786a-1531-4dc9-a36f-933754953010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:12.960856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be786a-1531-4dc9-a36f-933754953010 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:12.961133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be786a-1531-4dc9-a36f-933754953010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:12.961537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be786a-1531-4dc9-a36f-933754953010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:12.970913 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be786a-1531-4dc9-a36f-933754953010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:12.972433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be786a-1531-4dc9-a36f-933754953010 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:12.983196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1288/2567] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:13.046841 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4ad7-b087-416c-a668-c0a32b20a549 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:13.049275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-162c4ad7-b087-416c-a668-c0a32b20a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:13.057337 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be786a-1531-4dc9-a36f-933754953010 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:13.058508 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:13.126000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be786a-1531-4dc9-a36f-933754953010 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:13.131048 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:13.131654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:13.131935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:13.132216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] PATH_INFO: `/v3/users/5075a69eebba420f9433751f0c150e11` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:13.133375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5075a69eebba420f9433751f0c150e11)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:13.135358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:13.138891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4ad7-b087-416c-a668-c0a32b20a549 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:13.145740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a11422-e2ab-4b54-8dd6-e2615a204c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bc75cc7beb54ef2abd4876b2b35675e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:13.155006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a11422-e2ab-4b54-8dd6-e2615a204c78 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:13.155006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a11422-e2ab-4b54-8dd6-e2615a204c78 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:13.155006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a11422-e2ab-4b54-8dd6-e2615a204c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:13.155006 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c4a11422-e2ab-4b54-8dd6-e2615a204c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:13.211778 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a11422-e2ab-4b54-8dd6-e2615a204c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:13.213369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a11422-e2ab-4b54-8dd6-e2615a204c78 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:13.223244 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1280/2568] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:13.434683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:13.441751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5075a69eebba420f9433751f0c150e11'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:13.442431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5075a69eebba420f9433751f0c150e11'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:13.449403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5075a69eebba420f9433751f0c150e11'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:13.462121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5075a69eebba420f9433751f0c150e11'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:13.464203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5075a69eebba420f9433751f0c150e11'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:13.565078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1289/2569] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:13 2022] DELETE /identity/v3/users/5075a69eebba420f9433751f0c150e11 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:13.569657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1db32-3acb-4754-b512-98e3f10b633f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:13.569994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1db32-3acb-4754-b512-98e3f10b633f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:13.570306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1db32-3acb-4754-b512-98e3f10b633f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:13.589335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-eab1db32-3acb-4754-b512-98e3f10b633f None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:13.591199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-eab1db32-3acb-4754-b512-98e3f10b633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:13.651697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1281/2570] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:13.662328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:13.663755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:13.723799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbb3ac-6726-4339-a2ff-e995315f4584 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:13.727598 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37ffd1-c444-4afb-bd70-16587561b8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:13.728226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37ffd1-c444-4afb-bd70-16587561b8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:13.728504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37ffd1-c444-4afb-bd70-16587561b8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:13.728775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37ffd1-c444-4afb-bd70-16587561b8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:13.746517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37ffd1-c444-4afb-bd70-16587561b8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:13.748076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37ffd1-c444-4afb-bd70-16587561b8d6 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:13.757696 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1290/2571] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:14.263993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1db32-3acb-4754-b512-98e3f10b633f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:14.266160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-eab1db32-3acb-4754-b512-98e3f10b633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:14.281370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1db32-3acb-4754-b512-98e3f10b633f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:14.299356 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:14.300259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:14.300372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:14.300559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] PATH_INFO: `/v3/projects/43fe15bb50d6458996f3c8468e861bf7` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:14.301687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fe15bb50d6458996f3c8468e861bf7)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:14.303614 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:14.423331 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:14.431867 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fe15bb50d6458996f3c8468e861bf7', 'request_id': 'req-85e1e815-b3e2-433d-a793-75986312297d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.505329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fe15bb50d6458996f3c8468e861bf7', 'request_id': 'req-85e1e815-b3e2-433d-a793-75986312297d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.512135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fe15bb50d6458996f3c8468e861bf7', 'request_id': 'req-85e1e815-b3e2-433d-a793-75986312297d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.525297 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] The token cache is being invalidate because project 43fe15bb50d6458996f3c8468e861bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:14.525699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.527596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.528213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1282/2572] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:14 2022] DELETE /identity/v3/projects/43fe15bb50d6458996f3c8468e861bf7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:14.532536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37ffd1-c444-4afb-bd70-16587561b8d6 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:14.544524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37ffd1-c444-4afb-bd70-16587561b8d6 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:14.611292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:14.611957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:14.612237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:14.612509 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] PATH_INFO: `/v3/users/1ff9ee853a524e79aeaa525d03777f8f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:14.613849 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff9ee853a524e79aeaa525d03777f8f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:14.615780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:14.797858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff9ee853a524e79aeaa525d03777f8f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.798603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff9ee853a524e79aeaa525d03777f8f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.805771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff9ee853a524e79aeaa525d03777f8f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.807697 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:14.819635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff9ee853a524e79aeaa525d03777f8f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.820521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c9e21823-7be0-446e-b14c-65742edea987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff9ee853a524e79aeaa525d03777f8f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:14.882635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1291/2573] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:14 2022] DELETE /identity/v3/users/1ff9ee853a524e79aeaa525d03777f8f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:15.362703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:15.364643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:15.378416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1e815-b3e2-433d-a793-75986312297d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:15.454063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:15.454693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:15.454970 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:15.455238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] PATH_INFO: `/v3/projects/bbd7b353605c4061874e3b8aa9d2a2bc` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:15.456347 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd7b353605c4061874e3b8aa9d2a2bc)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:15.458270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:15.551602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd7b353605c4061874e3b8aa9d2a2bc', 'request_id': 'req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:15.625293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd7b353605c4061874e3b8aa9d2a2bc', 'request_id': 'req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:15.631501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd7b353605c4061874e3b8aa9d2a2bc', 'request_id': 'req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:15.643972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] The token cache is being invalidate because project bbd7b353605c4061874e3b8aa9d2a2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:15.644152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:15.644855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56b4c743-7690-4d08-b1e1-b5f4b8c5b304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:15.646304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1283/2574] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:15 2022] DELETE /identity/v3/projects/bbd7b353605c4061874e3b8aa9d2a2bc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:15.651260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebf9b-02de-4353-b790-8a5e4dfa0a0b None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:15.651742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebf9b-02de-4353-b790-8a5e4dfa0a0b None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:15.652003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebf9b-02de-4353-b790-8a5e4dfa0a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:15.672141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f16ebf9b-02de-4353-b790-8a5e4dfa0a0b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:15.673343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f16ebf9b-02de-4353-b790-8a5e4dfa0a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:15.739101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1292/2575] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:15.747862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6416754-3550-4130-808f-307405636dc1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:15.748187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6416754-3550-4130-808f-307405636dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:15.748574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6416754-3550-4130-808f-307405636dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:15.773267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f6416754-3550-4130-808f-307405636dc1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:15.774810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f6416754-3550-4130-808f-307405636dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:15.784673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1284/2576] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:15.789020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ebf9b-02de-4353-b790-8a5e4dfa0a0b None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:15.802003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ebf9b-02de-4353-b790-8a5e4dfa0a0b None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:15.812267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:15.812950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:15.813288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:15.813625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:15.814511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:46:15.814881 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:15.817058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:15.833970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1293/2577] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:46:15.838242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6416754-3550-4130-808f-307405636dc1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:15.847988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6416754-3550-4130-808f-307405636dc1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:15.852939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485538-4be4-4112-8e28-d9032d16ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:15.853649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485538-4be4-4112-8e28-d9032d16ac61 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:15.853860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485538-4be4-4112-8e28-d9032d16ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:15.854124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba485538-4be4-4112-8e28-d9032d16ac61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:15.854757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba485538-4be4-4112-8e28-d9032d16ac61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:15.856668 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba485538-4be4-4112-8e28-d9032d16ac61 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:15.982345 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1285/2578] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:15 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:15.986539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:15.997583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112791a-80b0-453e-995d-8b65d6c018ec admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:16.054276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb40c-e10f-4368-a183-bf650054f046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:16.054889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb40c-e10f-4368-a183-bf650054f046 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.055165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb40c-e10f-4368-a183-bf650054f046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.055438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb40c-e10f-4368-a183-bf650054f046 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.056094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb40c-e10f-4368-a183-bf650054f046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:16.058035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb40c-e10f-4368-a183-bf650054f046 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:16.136101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1294/2579] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:15 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:16.140966 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485538-4be4-4112-8e28-d9032d16ac61 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:16.151611 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba485538-4be4-4112-8e28-d9032d16ac61 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:16.156646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b4bf7-8f0c-4157-9317-8c5ec6cf1dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:16.157242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4bf7-8f0c-4157-9317-8c5ec6cf1dba admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.157520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4bf7-8f0c-4157-9317-8c5ec6cf1dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.157791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b4bf7-8f0c-4157-9317-8c5ec6cf1dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.158467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b4bf7-8f0c-4157-9317-8c5ec6cf1dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:16.160044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b4bf7-8f0c-4157-9317-8c5ec6cf1dba admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:16.170810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1286/2580] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:46:16.175780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb40c-e10f-4368-a183-bf650054f046 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:16.187181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb40c-e10f-4368-a183-bf650054f046 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:16.192068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afaddb1-961c-49e6-987c-9b8fab18bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:16.192672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaddb1-961c-49e6-987c-9b8fab18bd47 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.192953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaddb1-961c-49e6-987c-9b8fab18bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.193228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaddb1-961c-49e6-987c-9b8fab18bd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.193870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afaddb1-961c-49e6-987c-9b8fab18bd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:16.195560 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afaddb1-961c-49e6-987c-9b8fab18bd47 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:16.206442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1295/2581] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:16.213689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b4bf7-8f0c-4157-9317-8c5ec6cf1dba admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:16.222525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b4bf7-8f0c-4157-9317-8c5ec6cf1dba admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:16.227656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb8953-3b12-44cd-8a75-28f9d27ccf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:16.230779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb8953-3b12-44cd-8a75-28f9d27ccf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.230779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb8953-3b12-44cd-8a75-28f9d27ccf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.230779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb8953-3b12-44cd-8a75-28f9d27ccf52 admin admin] PATH_INFO: `/v3/projects/5ea03af3f2e54fe5bececa62587ee288/users/d42f3fec7070455ca6b23dd65ae9a58d/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.242062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:16.245473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb8953-3b12-44cd-8a75-28f9d27ccf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea03af3f2e54fe5bececa62587ee288, user_id=d42f3fec7070455ca6b23dd65ae9a58d, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:16.248474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb8953-3b12-44cd-8a75-28f9d27ccf52 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:16.353860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1287/2582] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:16 2022] PUT /identity/v3/projects/5ea03af3f2e54fe5bececa62587ee288/users/d42f3fec7070455ca6b23dd65ae9a58d/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:16.363235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f76498-cab9-49d1-b7f8-1d237cba1851 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.363692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f76498-cab9-49d1-b7f8-1d237cba1851 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.364124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f76498-cab9-49d1-b7f8-1d237cba1851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.399404 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e3f76498-cab9-49d1-b7f8-1d237cba1851 None None] MFA Rules not processed for user `d42f3fec7070455ca6b23dd65ae9a58d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:16.400699 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e3f76498-cab9-49d1-b7f8-1d237cba1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:16.436269 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:16.474845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1296/2583] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:16.479392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb8953-3b12-44cd-8a75-28f9d27ccf52 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:16.551173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb8953-3b12-44cd-8a75-28f9d27ccf52 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:16.557546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81d477-8f30-4344-99cf-22dbfe4f4a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:16.558518 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81d477-8f30-4344-99cf-22dbfe4f4a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.559110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81d477-8f30-4344-99cf-22dbfe4f4a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.559538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81d477-8f30-4344-99cf-22dbfe4f4a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.560603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81d477-8f30-4344-99cf-22dbfe4f4a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:16.563875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81d477-8f30-4344-99cf-22dbfe4f4a1b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:16.650235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1288/2584] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:16 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:16.655047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f76498-cab9-49d1-b7f8-1d237cba1851 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:16.665758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f76498-cab9-49d1-b7f8-1d237cba1851 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:16.724037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857c6f0-446f-4672-bc28-8e27c6611414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:16.724605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857c6f0-446f-4672-bc28-8e27c6611414 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.724884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857c6f0-446f-4672-bc28-8e27c6611414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.725153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857c6f0-446f-4672-bc28-8e27c6611414 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.725820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857c6f0-446f-4672-bc28-8e27c6611414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:16.727809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857c6f0-446f-4672-bc28-8e27c6611414 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:16.884328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1297/2585] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:16 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:16.889363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81d477-8f30-4344-99cf-22dbfe4f4a1b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:16.900730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81d477-8f30-4344-99cf-22dbfe4f4a1b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:16.906452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e980b82-23e0-4955-9b5f-188459af4d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:16.907286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980b82-23e0-4955-9b5f-188459af4d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.907547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980b82-23e0-4955-9b5f-188459af4d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.907863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980b82-23e0-4955-9b5f-188459af4d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.908542 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e980b82-23e0-4955-9b5f-188459af4d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:16.910263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e980b82-23e0-4955-9b5f-188459af4d1f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:16.926530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1289/2586] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:16.927962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857c6f0-446f-4672-bc28-8e27c6611414 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:16.939750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857c6f0-446f-4672-bc28-8e27c6611414 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:16.944954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c4cfc-a30d-4554-8e5f-cd0f9375444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:16.945717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4cfc-a30d-4554-8e5f-cd0f9375444c admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:16.946021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4cfc-a30d-4554-8e5f-cd0f9375444c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:16.946305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c4cfc-a30d-4554-8e5f-cd0f9375444c admin admin] PATH_INFO: `/v3/projects/d97e80a9114f499f8d5104b17404010c/users/c0f58b38d71a474ebfe2f2086733e0e5/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:16.964911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c4cfc-a30d-4554-8e5f-cd0f9375444c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97e80a9114f499f8d5104b17404010c, user_id=c0f58b38d71a474ebfe2f2086733e0e5, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:16.968353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c4cfc-a30d-4554-8e5f-cd0f9375444c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:17.083683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1298/2587] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:16 2022] PUT /identity/v3/projects/d97e80a9114f499f8d5104b17404010c/users/c0f58b38d71a474ebfe2f2086733e0e5/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:17.087930 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e980b82-23e0-4955-9b5f-188459af4d1f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:17.098562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e980b82-23e0-4955-9b5f-188459af4d1f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:17.177553 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b75031-6765-4c93-81e0-9dd57cc3978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:17.178191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b75031-6765-4c93-81e0-9dd57cc3978a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:17.178469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b75031-6765-4c93-81e0-9dd57cc3978a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:17.178740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b75031-6765-4c93-81e0-9dd57cc3978a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:17.179368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b75031-6765-4c93-81e0-9dd57cc3978a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:17.180941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b75031-6765-4c93-81e0-9dd57cc3978a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:17.193215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1290/2588] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:46:17.197431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c4cfc-a30d-4554-8e5f-cd0f9375444c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:17.208228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c4cfc-a30d-4554-8e5f-cd0f9375444c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:17.212947 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:17.213589 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:17.213865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:17.214170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] PATH_INFO: `/v3/projects/d97e80a9114f499f8d5104b17404010c/users/c0f58b38d71a474ebfe2f2086733e0e5/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:17.216549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97e80a9114f499f8d5104b17404010c, user_id=c0f58b38d71a474ebfe2f2086733e0e5, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:17.219085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:17.230688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1299/2589] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:17 2022] PUT /identity/v3/projects/d97e80a9114f499f8d5104b17404010c/users/c0f58b38d71a474ebfe2f2086733e0e5/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:17.241586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f459cf-7b18-4869-8598-d4041274c19e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:17.241877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f459cf-7b18-4869-8598-d4041274c19e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:17.242206 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f459cf-7b18-4869-8598-d4041274c19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:17.272161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-55f459cf-7b18-4869-8598-d4041274c19e None None] MFA Rules not processed for user `c0f58b38d71a474ebfe2f2086733e0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:17.273386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55f459cf-7b18-4869-8598-d4041274c19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:17.324008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:17.346658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1291/2590] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:17.359203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:17.361033 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:17.422887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8510e9f-c32b-4abd-b4e2-ebcbfd2e9380 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:17.426547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373078b-0f43-46e9-b5f9-418e660ad3ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:17.427156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373078b-0f43-46e9-b5f9-418e660ad3ec service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:17.427432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373078b-0f43-46e9-b5f9-418e660ad3ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:17.427721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373078b-0f43-46e9-b5f9-418e660ad3ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:17.437938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373078b-0f43-46e9-b5f9-418e660ad3ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:17.439383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373078b-0f43-46e9-b5f9-418e660ad3ec service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:17.448838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1300/2591] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:18.607624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f459cf-7b18-4869-8598-d4041274c19e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:18.673939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f459cf-7b18-4869-8598-d4041274c19e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:18.679026 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:18.679792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:18.680069 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:18.680342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] PATH_INFO: `/v3/users/d42f3fec7070455ca6b23dd65ae9a58d` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:18.681524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42f3fec7070455ca6b23dd65ae9a58d)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:18.683484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:18.857757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42f3fec7070455ca6b23dd65ae9a58d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:18.874528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42f3fec7070455ca6b23dd65ae9a58d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:19.169646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42f3fec7070455ca6b23dd65ae9a58d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:19.170254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42f3fec7070455ca6b23dd65ae9a58d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:19.177922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42f3fec7070455ca6b23dd65ae9a58d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:19.184958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1292/2592] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:18 2022] DELETE /identity/v3/users/d42f3fec7070455ca6b23dd65ae9a58d => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:19.190713 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a745-91d2-4648-96b2-24e5d6b410df None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:19.191237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a745-91d2-4648-96b2-24e5d6b410df None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:19.191591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a745-91d2-4648-96b2-24e5d6b410df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:19.219788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-5815a745-91d2-4648-96b2-24e5d6b410df None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:19.221020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5815a745-91d2-4648-96b2-24e5d6b410df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:19.247767 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:19.287271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1301/2593] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:19.298534 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:19.300033 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:19.379904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81187ba-7508-46ad-b5a8-4db51efce504 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:19.384019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db071b5-a21c-4641-995b-4d8a445cfb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:19.384819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db071b5-a21c-4641-995b-4d8a445cfb2a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:19.385197 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db071b5-a21c-4641-995b-4d8a445cfb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:19.385703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db071b5-a21c-4641-995b-4d8a445cfb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:19.399307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db071b5-a21c-4641-995b-4d8a445cfb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:19.401610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db071b5-a21c-4641-995b-4d8a445cfb2a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:19.415198 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1293/2594] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:46:19.800055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815a745-91d2-4648-96b2-24e5d6b410df None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:19.801655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-5815a745-91d2-4648-96b2-24e5d6b410df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:19.815066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815a745-91d2-4648-96b2-24e5d6b410df None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:19.819851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:19.820561 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:19.820771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:19.821172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] PATH_INFO: `/v3/projects/5ea03af3f2e54fe5bececa62587ee288` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:19.822385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea03af3f2e54fe5bececa62587ee288)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:19.824335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:19.958228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea03af3f2e54fe5bececa62587ee288', 'request_id': 'req-d33bb714-e426-43a9-84d0-951cd8b29010'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.037062 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea03af3f2e54fe5bececa62587ee288', 'request_id': 'req-d33bb714-e426-43a9-84d0-951cd8b29010'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.044820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea03af3f2e54fe5bececa62587ee288', 'request_id': 'req-d33bb714-e426-43a9-84d0-951cd8b29010'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.055980 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] The token cache is being invalidate because project 5ea03af3f2e54fe5bececa62587ee288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:20.056267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.056929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.058481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1302/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:19 2022] DELETE /identity/v3/projects/5ea03af3f2e54fe5bececa62587ee288 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:20.063398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db071b5-a21c-4641-995b-4d8a445cfb2a service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:20.073060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db071b5-a21c-4641-995b-4d8a445cfb2a service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:20.078414 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:20.130246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:20.130882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:20.131158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:20.131432 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] PATH_INFO: `/v3/users/c0f58b38d71a474ebfe2f2086733e0e5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:20.132559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f58b38d71a474ebfe2f2086733e0e5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:20.134488 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:20.326967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f58b38d71a474ebfe2f2086733e0e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.340714 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f58b38d71a474ebfe2f2086733e0e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.465957 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f58b38d71a474ebfe2f2086733e0e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.466603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f58b38d71a474ebfe2f2086733e0e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.475423 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cb68f58-0ded-45bf-9853-07d96fc17899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f58b38d71a474ebfe2f2086733e0e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:20.482227 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1294/2596] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:20 2022] DELETE /identity/v3/users/c0f58b38d71a474ebfe2f2086733e0e5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:21.177277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:21.179265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:21.194580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb714-e426-43a9-84d0-951cd8b29010 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:21.260273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:21.262584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:21.262584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:21.262584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] PATH_INFO: `/v3/projects/d97e80a9114f499f8d5104b17404010c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:21.263233 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97e80a9114f499f8d5104b17404010c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:21.265168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:21.395656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97e80a9114f499f8d5104b17404010c', 'request_id': 'req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:21.398391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:21.500142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97e80a9114f499f8d5104b17404010c', 'request_id': 'req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:21.507210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97e80a9114f499f8d5104b17404010c', 'request_id': 'req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:21.518084 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] The token cache is being invalidate because project d97e80a9114f499f8d5104b17404010c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:21.518376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:21.519029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-80f5ecc2-a6b1-41b7-80c6-ea5f88b4dfd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:21.520510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1303/2597] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:21 2022] DELETE /identity/v3/projects/d97e80a9114f499f8d5104b17404010c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:21.525431 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329433be-9532-43d2-aafb-a3e35a57d16e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:21.525956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329433be-9532-43d2-aafb-a3e35a57d16e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:21.526284 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329433be-9532-43d2-aafb-a3e35a57d16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:21.548134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-329433be-9532-43d2-aafb-a3e35a57d16e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:21.549557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-329433be-9532-43d2-aafb-a3e35a57d16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:21.615502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1295/2598] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:21.624566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354301d-c2bf-45e5-809a-e62967a653e1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:21.624882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354301d-c2bf-45e5-809a-e62967a653e1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:21.625164 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354301d-c2bf-45e5-809a-e62967a653e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:21.646203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4354301d-c2bf-45e5-809a-e62967a653e1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:21.647423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4354301d-c2bf-45e5-809a-e62967a653e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:21.656297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1304/2599] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:21.660826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329433be-9532-43d2-aafb-a3e35a57d16e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:21.671290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329433be-9532-43d2-aafb-a3e35a57d16e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:21.675876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:21.676477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:21.676755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:21.677048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:21.677691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:46:21.678018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:21.679603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:21.692153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1296/2600] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:46:21.696809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354301d-c2bf-45e5-809a-e62967a653e1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:21.706938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354301d-c2bf-45e5-809a-e62967a653e1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:21.711588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fdd09-74f4-4556-8d24-d77a0d1c29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:21.712190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fdd09-74f4-4556-8d24-d77a0d1c29af admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:21.712470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fdd09-74f4-4556-8d24-d77a0d1c29af admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:21.712744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fdd09-74f4-4556-8d24-d77a0d1c29af admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:21.713389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fdd09-74f4-4556-8d24-d77a0d1c29af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:21.716150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fdd09-74f4-4556-8d24-d77a0d1c29af admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:21.805144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1305/2601] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:21 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:21.809639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:21.820570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979ef5-8e79-48e8-9747-91d33afea9a2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:21.834019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:21.882422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12e126-ebeb-4885-bc87-f0e37e139025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:21.883037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e126-ebeb-4885-bc87-f0e37e139025 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:21.883314 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e126-ebeb-4885-bc87-f0e37e139025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:21.883583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12e126-ebeb-4885-bc87-f0e37e139025 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:21.884257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12e126-ebeb-4885-bc87-f0e37e139025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:21.886203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12e126-ebeb-4885-bc87-f0e37e139025 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:21.994912 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1297/2602] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:21 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:21.996220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fdd09-74f4-4556-8d24-d77a0d1c29af admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:22.007865 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fdd09-74f4-4556-8d24-d77a0d1c29af admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:22.013558 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02935c-5dee-4231-905e-f6e4ad7c5f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:22.014264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02935c-5dee-4231-905e-f6e4ad7c5f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:22.014674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02935c-5dee-4231-905e-f6e4ad7c5f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:22.014953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02935c-5dee-4231-905e-f6e4ad7c5f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:22.015631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02935c-5dee-4231-905e-f6e4ad7c5f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:22.017226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02935c-5dee-4231-905e-f6e4ad7c5f2f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:22.035528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1306/2603] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:22.037186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12e126-ebeb-4885-bc87-f0e37e139025 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:22.047773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12e126-ebeb-4885-bc87-f0e37e139025 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:22.052716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d99a8-af15-46e3-ba36-a7cd08ab546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:22.053324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d99a8-af15-46e3-ba36-a7cd08ab546c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:22.053604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d99a8-af15-46e3-ba36-a7cd08ab546c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:22.053875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d99a8-af15-46e3-ba36-a7cd08ab546c admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:22.058040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d99a8-af15-46e3-ba36-a7cd08ab546c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:22.058040 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d99a8-af15-46e3-ba36-a7cd08ab546c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:22.072942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1298/2604] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:22.078799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02935c-5dee-4231-905e-f6e4ad7c5f2f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:22.089336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02935c-5dee-4231-905e-f6e4ad7c5f2f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:22.094863 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:22.095564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:22.095847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:22.096124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] PATH_INFO: `/v3/projects/a2876c8878cd4e6d8b21e5b0930a44a7/users/b598c017fd9e40148daadb2957a3b40b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:22.111279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2876c8878cd4e6d8b21e5b0930a44a7, user_id=b598c017fd9e40148daadb2957a3b40b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:22.115417 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:22.197672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1307/2605] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:22 2022] PUT /identity/v3/projects/a2876c8878cd4e6d8b21e5b0930a44a7/users/b598c017fd9e40148daadb2957a3b40b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:22.210200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbe805-9b67-48c5-b9bf-4606fc71e8be None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:22.210492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbe805-9b67-48c5-b9bf-4606fc71e8be None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:22.210774 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbe805-9b67-48c5-b9bf-4606fc71e8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:22.243343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-41cbe805-9b67-48c5-b9bf-4606fc71e8be None None] MFA Rules not processed for user `b598c017fd9e40148daadb2957a3b40b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:22.244570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-41cbe805-9b67-48c5-b9bf-4606fc71e8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:22.311451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1299/2606] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:22.322804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:22.325358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:22.382838 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0182ea-96ab-4282-a6a6-e35c9d175190 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:22.386555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfca9-22dc-41d6-b9ba-714dfc7aa05d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:22.387757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfca9-22dc-41d6-b9ba-714dfc7aa05d service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:22.388034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfca9-22dc-41d6-b9ba-714dfc7aa05d service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:22.388305 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfca9-22dc-41d6-b9ba-714dfc7aa05d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:22.397559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfca9-22dc-41d6-b9ba-714dfc7aa05d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:22.403482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfca9-22dc-41d6-b9ba-714dfc7aa05d service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:22.408928 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1308/2607] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:22.428690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbe805-9b67-48c5-b9bf-4606fc71e8be None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:22.494880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbe805-9b67-48c5-b9bf-4606fc71e8be None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:22.501048 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:22.501630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:22.501909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:22.502218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] PATH_INFO: `/v3/users/b598c017fd9e40148daadb2957a3b40b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:22.503387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b598c017fd9e40148daadb2957a3b40b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:22.505367 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:22.598180 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:22.663237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b598c017fd9e40148daadb2957a3b40b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:22.674954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b598c017fd9e40148daadb2957a3b40b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:22.734275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b598c017fd9e40148daadb2957a3b40b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:22.734906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b598c017fd9e40148daadb2957a3b40b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:22.742435 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b598c017fd9e40148daadb2957a3b40b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:22.748934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1300/2608] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:22 2022] DELETE /identity/v3/users/b598c017fd9e40148daadb2957a3b40b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:22.753867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb8a7-5ec0-4474-bdb9-02e0efdb6fb6 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:22.754150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb8a7-5ec0-4474-bdb9-02e0efdb6fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:22.754456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb8a7-5ec0-4474-bdb9-02e0efdb6fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:22.773100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-ceedb8a7-5ec0-4474-bdb9-02e0efdb6fb6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:22.774329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ceedb8a7-5ec0-4474-bdb9-02e0efdb6fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:22.834203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1309/2609] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:22.844568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:22.845958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:22.904035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309521c5-1cfd-4d46-9ae1-d27a32a949ef admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:22.907734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b1417-9f4c-49fb-a95e-f1158dca7db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:22.908337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1417-9f4c-49fb-a95e-f1158dca7db4 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:22.908613 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1417-9f4c-49fb-a95e-f1158dca7db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:22.908880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1417-9f4c-49fb-a95e-f1158dca7db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:22.918775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b1417-9f4c-49fb-a95e-f1158dca7db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:22.920210 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b1417-9f4c-49fb-a95e-f1158dca7db4 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:22.930942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1301/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:23.415603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb8a7-5ec0-4474-bdb9-02e0efdb6fb6 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:23.417106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-ceedb8a7-5ec0-4474-bdb9-02e0efdb6fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:23.430446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb8a7-5ec0-4474-bdb9-02e0efdb6fb6 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:23.435492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:23.436393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:23.436671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:23.436941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] PATH_INFO: `/v3/projects/a2876c8878cd4e6d8b21e5b0930a44a7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:23.438131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2876c8878cd4e6d8b21e5b0930a44a7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:23.440327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:23.457819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:23.580769 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2876c8878cd4e6d8b21e5b0930a44a7', 'request_id': 'req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:23.729300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2876c8878cd4e6d8b21e5b0930a44a7', 'request_id': 'req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:23.736214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2876c8878cd4e6d8b21e5b0930a44a7', 'request_id': 'req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:23.746936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] The token cache is being invalidate because project a2876c8878cd4e6d8b21e5b0930a44a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:23.747228 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:23.747884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-dcef9f44-c6cb-478d-bf6b-45db2a443b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:23.749373 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1310/2611] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:23 2022] DELETE /identity/v3/projects/a2876c8878cd4e6d8b21e5b0930a44a7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:23.754344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97689-95e4-457a-a183-c196afc6e3d5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:23.754846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97689-95e4-457a-a183-c196afc6e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:23.754947 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a97689-95e4-457a-a183-c196afc6e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:23.774817 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-10a97689-95e4-457a-a183-c196afc6e3d5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:23.776011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-10a97689-95e4-457a-a183-c196afc6e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:23.840065 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1302/2612] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:23.847773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743dcb-c3b1-4eca-a5f7-ebbfa3984bdf None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:23.848057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743dcb-c3b1-4eca-a5f7-ebbfa3984bdf None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:23.848332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743dcb-c3b1-4eca-a5f7-ebbfa3984bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:23.868467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7b743dcb-c3b1-4eca-a5f7-ebbfa3984bdf None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:23.869729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7b743dcb-c3b1-4eca-a5f7-ebbfa3984bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:23.878466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1311/2613] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:23.882940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a97689-95e4-457a-a183-c196afc6e3d5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:23.892981 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a97689-95e4-457a-a183-c196afc6e3d5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:23.897530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:23.898149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:23.898428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:23.898698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:23.899336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:46:23.899662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:23.901230 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:23.915287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1303/2614] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:46:23.920462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743dcb-c3b1-4eca-a5f7-ebbfa3984bdf None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:23.930650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743dcb-c3b1-4eca-a5f7-ebbfa3984bdf None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:23.936471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4abb8-284f-401c-8917-886d70329c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:23.937105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4abb8-284f-401c-8917-886d70329c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:23.937366 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4abb8-284f-401c-8917-886d70329c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:23.937635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4abb8-284f-401c-8917-886d70329c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:23.938844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4abb8-284f-401c-8917-886d70329c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:23.940237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4abb8-284f-401c-8917-886d70329c90 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:24.056081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1312/2615] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:23 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:24.061494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:24.084594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65dbce-d3c4-43fc-b820-b8c549e05dad admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:24.129736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:24.156284 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339fd0d-d560-4737-8a2a-efc6d3e52207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:24.156876 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339fd0d-d560-4737-8a2a-efc6d3e52207 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:24.157158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339fd0d-d560-4737-8a2a-efc6d3e52207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:24.157430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339fd0d-d560-4737-8a2a-efc6d3e52207 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:24.158100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339fd0d-d560-4737-8a2a-efc6d3e52207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:24.159986 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339fd0d-d560-4737-8a2a-efc6d3e52207 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:24.251424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1304/2616] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:24 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:24.255577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4abb8-284f-401c-8917-886d70329c90 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:24.268071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4abb8-284f-401c-8917-886d70329c90 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:24.273051 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae6ff-1553-4753-9f9a-10d28c4df01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:24.273755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae6ff-1553-4753-9f9a-10d28c4df01f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:24.274186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae6ff-1553-4753-9f9a-10d28c4df01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:24.274473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ae6ff-1553-4753-9f9a-10d28c4df01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:24.275375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ae6ff-1553-4753-9f9a-10d28c4df01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:24.277123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ae6ff-1553-4753-9f9a-10d28c4df01f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:24.300736 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1313/2617] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:24.302541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339fd0d-d560-4737-8a2a-efc6d3e52207 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:24.319652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339fd0d-d560-4737-8a2a-efc6d3e52207 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:24.326915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bdeeb-8903-4d9b-a1e7-49c731b711a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:24.327607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdeeb-8903-4d9b-a1e7-49c731b711a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:24.327966 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdeeb-8903-4d9b-a1e7-49c731b711a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:24.328247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bdeeb-8903-4d9b-a1e7-49c731b711a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:24.329018 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bdeeb-8903-4d9b-a1e7-49c731b711a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:24.330810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bdeeb-8903-4d9b-a1e7-49c731b711a9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:24.353133 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1305/2618] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:46:24.357421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae6ff-1553-4753-9f9a-10d28c4df01f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:24.367823 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ae6ff-1553-4753-9f9a-10d28c4df01f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:24.372815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86988e6-8ae5-4132-ac20-69887d3cb00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:24.373470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86988e6-8ae5-4132-ac20-69887d3cb00d admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:24.373772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86988e6-8ae5-4132-ac20-69887d3cb00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:24.374077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86988e6-8ae5-4132-ac20-69887d3cb00d admin admin] PATH_INFO: `/v3/projects/ccccf7de26e54088baa1cc9e8beb7665/users/6e02cdf4466d48968abfaa6dfbf72c7e/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:24.390138 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86988e6-8ae5-4132-ac20-69887d3cb00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccccf7de26e54088baa1cc9e8beb7665, user_id=6e02cdf4466d48968abfaa6dfbf72c7e, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:24.392852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86988e6-8ae5-4132-ac20-69887d3cb00d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:24.459823 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b56a-a416-4485-8d94-29f52cfec17c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:24.464812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b56a-a416-4485-8d94-29f52cfec17c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:24.464812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b56a-a416-4485-8d94-29f52cfec17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:24.465630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1314/2619] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:24 2022] PUT /identity/v3/projects/ccccf7de26e54088baa1cc9e8beb7665/users/6e02cdf4466d48968abfaa6dfbf72c7e/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:24.475405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41287-a3f1-457e-bf43-7e6016fd6b39 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:24.475698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41287-a3f1-457e-bf43-7e6016fd6b39 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:24.475976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41287-a3f1-457e-bf43-7e6016fd6b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:24.481410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7220b56a-a416-4485-8d94-29f52cfec17c None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:24.482648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7220b56a-a416-4485-8d94-29f52cfec17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:24.504100 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-10b41287-a3f1-457e-bf43-7e6016fd6b39 None None] MFA Rules not processed for user `6e02cdf4466d48968abfaa6dfbf72c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:24.505383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-10b41287-a3f1-457e-bf43-7e6016fd6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:24.540883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1306/2620] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:46:24.567634 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b56a-a416-4485-8d94-29f52cfec17c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:24.569644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7220b56a-a416-4485-8d94-29f52cfec17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:24.578546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1315/2621] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:46:24.590478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b41287-a3f1-457e-bf43-7e6016fd6b39 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:24.592516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-10b41287-a3f1-457e-bf43-7e6016fd6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:24.641174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:24.654036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b56a-a416-4485-8d94-29f52cfec17c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:24.659212 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:24.659862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:24.660124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:24.660397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:24.668932 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:24.670595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:24.670876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b41287-a3f1-457e-bf43-7e6016fd6b39 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:24.674731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:24.675341 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:24.675663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:24.675973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:24.680517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1307/2622] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:46:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 22 14:46:24.685380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:24.687137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:24.697635 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1316/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:46:30.790255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:30.791809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:30.851245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:30.876684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db7de7-9edf-48fb-96d5-d4432155b616 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:30.881810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:30.882463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:30.882747 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:30.883021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:30.884840 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:30.897137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:30.898772 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:30.911402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1308/2624] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:31.087215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:31.088645 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:31.162244 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487aa8-662a-4038-95df-5f7cba634f2d service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:31.170954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:31.171610 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:31.171900 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:31.172167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] PATH_INFO: `/v3/users/26ef04369c1c4b96930ec99a231c6ce8` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:31.173338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ef04369c1c4b96930ec99a231c6ce8)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:31.175298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:31.432061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ef04369c1c4b96930ec99a231c6ce8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:31.432743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ef04369c1c4b96930ec99a231c6ce8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:31.443527 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ef04369c1c4b96930ec99a231c6ce8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:31.468820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ef04369c1c4b96930ec99a231c6ce8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:31.469578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ef04369c1c4b96930ec99a231c6ce8'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:31.550445 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1317/2625] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:31 2022] DELETE /identity/v3/users/26ef04369c1c4b96930ec99a231c6ce8 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:31.901859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:31.926559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328814cb-9491-4244-a52b-7fce857f28d5 service placement] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:32.043644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:32.044623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:32.045075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:32.045533 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] PATH_INFO: `/v3/projects/3d0ac9bc87c1477499c48856c5ccd5d5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:32.046699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0ac9bc87c1477499c48856c5ccd5d5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:32.048618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:32.267910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0ac9bc87c1477499c48856c5ccd5d5', 'request_id': 'req-bd78220c-a4b4-4936-878f-88c3e354f890'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.299749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:32.301408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:32.319372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cc0cb-41ad-408b-b9e8-29e861e2bacd admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:32.342622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0ac9bc87c1477499c48856c5ccd5d5', 'request_id': 'req-bd78220c-a4b4-4936-878f-88c3e354f890'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.350756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0ac9bc87c1477499c48856c5ccd5d5', 'request_id': 'req-bd78220c-a4b4-4936-878f-88c3e354f890'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.375536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] The token cache is being invalidate because project 3d0ac9bc87c1477499c48856c5ccd5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:32.375856 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.379556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd78220c-a4b4-4936-878f-88c3e354f890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.384550 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1309/2626] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:31 2022] DELETE /identity/v3/projects/3d0ac9bc87c1477499c48856c5ccd5d5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:32.447217 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:32.477215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:32.479372 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:32.485608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:32.485608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] PATH_INFO: `/v3/users/6e02cdf4466d48968abfaa6dfbf72c7e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:32.485608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e02cdf4466d48968abfaa6dfbf72c7e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:32.489855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:32.718314 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e02cdf4466d48968abfaa6dfbf72c7e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.719081 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e02cdf4466d48968abfaa6dfbf72c7e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.729788 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e02cdf4466d48968abfaa6dfbf72c7e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.750171 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e02cdf4466d48968abfaa6dfbf72c7e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.751032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e02cdf4466d48968abfaa6dfbf72c7e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:32.859945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1318/2627] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:32 2022] DELETE /identity/v3/users/6e02cdf4466d48968abfaa6dfbf72c7e => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:32.862204 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba749-331f-45ae-9fde-9184c89f2d00 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:32.862644 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba749-331f-45ae-9fde-9184c89f2d00 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:32.862984 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba749-331f-45ae-9fde-9184c89f2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:32.911060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-745ba749-331f-45ae-9fde-9184c89f2d00 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:32.912667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-745ba749-331f-45ae-9fde-9184c89f2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:33.015031 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1310/2628] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:33.024875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:33.026433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:33.111388 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854fdc-c1ba-4526-8a70-91c0e8230dea admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:33.117272 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a69c9-c580-4691-b265-aa8eed6935fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:33.123555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a69c9-c580-4691-b265-aa8eed6935fc service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:33.123555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a69c9-c580-4691-b265-aa8eed6935fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:33.123555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a69c9-c580-4691-b265-aa8eed6935fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:33.129729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a69c9-c580-4691-b265-aa8eed6935fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:33.131348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a69c9-c580-4691-b265-aa8eed6935fc service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:33.142894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1319/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:33.628858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ba749-331f-45ae-9fde-9184c89f2d00 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:33.630415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-745ba749-331f-45ae-9fde-9184c89f2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:33.655561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ba749-331f-45ae-9fde-9184c89f2d00 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:33.662186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:33.662916 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:33.663409 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:33.663759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] PATH_INFO: `/v3/projects/ccccf7de26e54088baa1cc9e8beb7665` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:33.665124 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccccf7de26e54088baa1cc9e8beb7665)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:33.667258 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:33.669829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:33.802575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccccf7de26e54088baa1cc9e8beb7665', 'request_id': 'req-1c420995-86de-4627-b93f-8ced2a392ca1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:33.883015 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccccf7de26e54088baa1cc9e8beb7665', 'request_id': 'req-1c420995-86de-4627-b93f-8ced2a392ca1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:33.894808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccccf7de26e54088baa1cc9e8beb7665', 'request_id': 'req-1c420995-86de-4627-b93f-8ced2a392ca1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:33.910748 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] The token cache is being invalidate because project ccccf7de26e54088baa1cc9e8beb7665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:33.911511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:33.912080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c420995-86de-4627-b93f-8ced2a392ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:33.913630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1311/2630] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:33 2022] DELETE /identity/v3/projects/ccccf7de26e54088baa1cc9e8beb7665 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:33.919316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7df82-8c48-4460-9087-073dd9e9caf0 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:33.919860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7df82-8c48-4460-9087-073dd9e9caf0 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:33.920002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7df82-8c48-4460-9087-073dd9e9caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:33.944591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-dbc7df82-8c48-4460-9087-073dd9e9caf0 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:33.946389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dbc7df82-8c48-4460-9087-073dd9e9caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:34.025046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1320/2631] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:34.034673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ad79-aad2-4d1c-8227-18ca0d558b5a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:34.035025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ad79-aad2-4d1c-8227-18ca0d558b5a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:34.035214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9ad79-aad2-4d1c-8227-18ca0d558b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:34.058484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-bdc9ad79-aad2-4d1c-8227-18ca0d558b5a None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:34.060498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bdc9ad79-aad2-4d1c-8227-18ca0d558b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:34.076967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1312/2632] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:34.078424 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7df82-8c48-4460-9087-073dd9e9caf0 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:34.090407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7df82-8c48-4460-9087-073dd9e9caf0 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:34.096021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:34.097651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:34.097651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:34.097651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:34.126325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:46:34.126325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:34.126325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:34.126325 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1321/2633] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:46:34.126895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9ad79-aad2-4d1c-8227-18ca0d558b5a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:34.128161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:34.147027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9ad79-aad2-4d1c-8227-18ca0d558b5a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:34.147027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763551b8-7fe5-4163-9d52-33eb7a7768f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:34.147027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763551b8-7fe5-4163-9d52-33eb7a7768f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:34.147027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763551b8-7fe5-4163-9d52-33eb7a7768f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:34.147557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763551b8-7fe5-4163-9d52-33eb7a7768f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:34.147557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763551b8-7fe5-4163-9d52-33eb7a7768f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:34.147557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763551b8-7fe5-4163-9d52-33eb7a7768f4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:34.616464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1313/2634] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:34 2022] POST /identity/v3/projects => generated 375 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:34.620581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:34.630893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7afe78-4a01-4078-b385-936f3ede318b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:34.693528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb74d2-c142-4bb5-bed9-2d55e42f8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:34.694086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb74d2-c142-4bb5-bed9-2d55e42f8735 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:34.694364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb74d2-c142-4bb5-bed9-2d55e42f8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:34.694631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb74d2-c142-4bb5-bed9-2d55e42f8735 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:34.695277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb74d2-c142-4bb5-bed9-2d55e42f8735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:34.697162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb74d2-c142-4bb5-bed9-2d55e42f8735 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:34.799701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1322/2635] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:34 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:34.803645 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763551b8-7fe5-4163-9d52-33eb7a7768f4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:34.818135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763551b8-7fe5-4163-9d52-33eb7a7768f4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:34.823163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42f344-f4d3-44e6-9b96-e344fc7193bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:34.826442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42f344-f4d3-44e6-9b96-e344fc7193bb admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:34.826442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42f344-f4d3-44e6-9b96-e344fc7193bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:34.826442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42f344-f4d3-44e6-9b96-e344fc7193bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:34.826442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42f344-f4d3-44e6-9b96-e344fc7193bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:34.827838 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42f344-f4d3-44e6-9b96-e344fc7193bb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:34.841385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1314/2636] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:34.845426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb74d2-c142-4bb5-bed9-2d55e42f8735 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:34.858944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb74d2-c142-4bb5-bed9-2d55e42f8735 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:34.863863 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bfdb8-5768-401d-bdbe-226d8ced4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:34.864467 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bfdb8-5768-401d-bdbe-226d8ced4c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:34.864751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bfdb8-5768-401d-bdbe-226d8ced4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:34.865031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bfdb8-5768-401d-bdbe-226d8ced4c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:34.865686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bfdb8-5768-401d-bdbe-226d8ced4c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:34.867459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bfdb8-5768-401d-bdbe-226d8ced4c0d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:34.881516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1323/2637] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:34.886136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42f344-f4d3-44e6-9b96-e344fc7193bb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:34.899816 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42f344-f4d3-44e6-9b96-e344fc7193bb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:34.908752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3209496-3c4f-4cc4-b073-46b73f867e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:34.909514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209496-3c4f-4cc4-b073-46b73f867e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:34.909729 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209496-3c4f-4cc4-b073-46b73f867e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:34.910032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209496-3c4f-4cc4-b073-46b73f867e20 admin admin] PATH_INFO: `/v3/projects/40c41530baa84741aa0114aa70c8a45f/users/2b0132c0e75946e7ac02bf692059c04d/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:34.929632 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3209496-3c4f-4cc4-b073-46b73f867e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c41530baa84741aa0114aa70c8a45f, user_id=2b0132c0e75946e7ac02bf692059c04d, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:34.932687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3209496-3c4f-4cc4-b073-46b73f867e20 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:35.030512 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1315/2638] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:34 2022] PUT /identity/v3/projects/40c41530baa84741aa0114aa70c8a45f/users/2b0132c0e75946e7ac02bf692059c04d/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:46:35.034019 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e57de-40de-4831-8420-a685f37fca41 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:35.035161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e57de-40de-4831-8420-a685f37fca41 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:35.035774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e57de-40de-4831-8420-a685f37fca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:35.075468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9f8e57de-40de-4831-8420-a685f37fca41 None None] MFA Rules not processed for user `2b0132c0e75946e7ac02bf692059c04d`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:35.076730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9f8e57de-40de-4831-8420-a685f37fca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:35.164090 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1324/2639] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:35.168706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3209496-3c4f-4cc4-b073-46b73f867e20 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:35.244277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3209496-3c4f-4cc4-b073-46b73f867e20 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:35.254072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4550-45de-4710-b0f9-b3cd7a8d3431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:35.254732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4550-45de-4710-b0f9-b3cd7a8d3431 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:35.255023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4550-45de-4710-b0f9-b3cd7a8d3431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:35.255408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4550-45de-4710-b0f9-b3cd7a8d3431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:35.256083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4550-45de-4710-b0f9-b3cd7a8d3431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:35.258168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4550-45de-4710-b0f9-b3cd7a8d3431 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:35.378109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1316/2640] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:35 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:46:35.386365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e57de-40de-4831-8420-a685f37fca41 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:35.398817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e57de-40de-4831-8420-a685f37fca41 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:35.461155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989bf7-3a36-4a2b-9828-d9d7e9d5a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:35.461932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989bf7-3a36-4a2b-9828-d9d7e9d5a51f admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:35.462254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989bf7-3a36-4a2b-9828-d9d7e9d5a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:35.462534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989bf7-3a36-4a2b-9828-d9d7e9d5a51f admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:35.463180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84989bf7-3a36-4a2b-9828-d9d7e9d5a51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:35.465313 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84989bf7-3a36-4a2b-9828-d9d7e9d5a51f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:35.564320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:35.571320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1325/2641] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:35 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:35.575897 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4550-45de-4710-b0f9-b3cd7a8d3431 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:35.586449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4550-45de-4710-b0f9-b3cd7a8d3431 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:35.591387 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07d378-e1e2-47ac-a14c-fe9c290092d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:35.591991 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d378-e1e2-47ac-a14c-fe9c290092d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:35.592276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d378-e1e2-47ac-a14c-fe9c290092d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:35.592554 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07d378-e1e2-47ac-a14c-fe9c290092d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:35.593200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07d378-e1e2-47ac-a14c-fe9c290092d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:35.594875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07d378-e1e2-47ac-a14c-fe9c290092d9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:35.600989 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:35.614995 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1317/2642] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:35.615216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989bf7-3a36-4a2b-9828-d9d7e9d5a51f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:35.623030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989bf7-3a36-4a2b-9828-d9d7e9d5a51f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:35.627673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e5d9-0303-46fd-96ef-fa2e05672186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:35.628332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e5d9-0303-46fd-96ef-fa2e05672186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:35.628614 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e5d9-0303-46fd-96ef-fa2e05672186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:35.628890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e5d9-0303-46fd-96ef-fa2e05672186 admin admin] PATH_INFO: `/v3/projects/c2568f9b894d410fa4e72cf64c177929/users/71a3b61ca9454715ad50240e7b1c3e24/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:35.644544 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e5d9-0303-46fd-96ef-fa2e05672186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2568f9b894d410fa4e72cf64c177929, user_id=71a3b61ca9454715ad50240e7b1c3e24, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:35.647380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e5d9-0303-46fd-96ef-fa2e05672186 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:35.745712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1326/2643] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:35 2022] PUT /identity/v3/projects/c2568f9b894d410fa4e72cf64c177929/users/71a3b61ca9454715ad50240e7b1c3e24/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:35.750720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07d378-e1e2-47ac-a14c-fe9c290092d9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:35.761235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07d378-e1e2-47ac-a14c-fe9c290092d9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:35.818380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e44cd-6c63-48aa-827e-6666b20bd1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:35.818988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e44cd-6c63-48aa-827e-6666b20bd1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:35.819270 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e44cd-6c63-48aa-827e-6666b20bd1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:35.819546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e44cd-6c63-48aa-827e-6666b20bd1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:35.820185 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e44cd-6c63-48aa-827e-6666b20bd1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:35.821769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e44cd-6c63-48aa-827e-6666b20bd1b0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:35.832082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1318/2644] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:46:35.836437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e5d9-0303-46fd-96ef-fa2e05672186 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:35.847851 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e5d9-0303-46fd-96ef-fa2e05672186 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:35.853148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:35.853809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:35.854115 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:35.854385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] PATH_INFO: `/v3/projects/c2568f9b894d410fa4e72cf64c177929/users/71a3b61ca9454715ad50240e7b1c3e24/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:35.857382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2568f9b894d410fa4e72cf64c177929, user_id=71a3b61ca9454715ad50240e7b1c3e24, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:35.859801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:35.872607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1327/2645] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:35 2022] PUT /identity/v3/projects/c2568f9b894d410fa4e72cf64c177929/users/71a3b61ca9454715ad50240e7b1c3e24/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:46:35.882427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c350-6277-4b56-aec5-5ea3a59c272a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:35.882719 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c350-6277-4b56-aec5-5ea3a59c272a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:35.883021 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c350-6277-4b56-aec5-5ea3a59c272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:35.917359 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-40c5c350-6277-4b56-aec5-5ea3a59c272a None None] MFA Rules not processed for user `71a3b61ca9454715ad50240e7b1c3e24`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:35.919519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-40c5c350-6277-4b56-aec5-5ea3a59c272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:35.992076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1319/2646] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:36.003819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:36.005499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:36.066082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a80b31-0701-4919-92cd-684937959398 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:36.070037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd070990-31b1-4e0a-be1f-e267be2eb1f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:36.070901 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd070990-31b1-4e0a-be1f-e267be2eb1f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:36.071209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd070990-31b1-4e0a-be1f-e267be2eb1f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:36.071504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd070990-31b1-4e0a-be1f-e267be2eb1f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:36.129152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd070990-31b1-4e0a-be1f-e267be2eb1f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:36.130541 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd070990-31b1-4e0a-be1f-e267be2eb1f3 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:36.140015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1328/2647] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:39.259009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5c350-6277-4b56-aec5-5ea3a59c272a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:39.332353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5c350-6277-4b56-aec5-5ea3a59c272a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:39.337293 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:39.338009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:39.343361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:39.343361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] PATH_INFO: `/v3/users/2b0132c0e75946e7ac02bf692059c04d` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:39.343361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0132c0e75946e7ac02bf692059c04d)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:39.343361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:39.372464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:39.509372 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0132c0e75946e7ac02bf692059c04d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:39.521732 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0132c0e75946e7ac02bf692059c04d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:39.584646 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0132c0e75946e7ac02bf692059c04d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:39.585291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0132c0e75946e7ac02bf692059c04d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:39.593575 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0132c0e75946e7ac02bf692059c04d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:39.599561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1320/2648] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:39 2022] DELETE /identity/v3/users/2b0132c0e75946e7ac02bf692059c04d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:39.604459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917a8ff-7113-4d63-bf99-e62c129909f1 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:39.604950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917a8ff-7113-4d63-bf99-e62c129909f1 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:39.605190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917a8ff-7113-4d63-bf99-e62c129909f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:39.625807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-f917a8ff-7113-4d63-bf99-e62c129909f1 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:39.627069 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f917a8ff-7113-4d63-bf99-e62c129909f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:39.692801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1329/2649] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:39.703677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:39.705236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:39.768377 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290e31a-b97f-4b3b-bc34-25e94ce5fefc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:39.771907 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99cb67-931d-48db-b43e-b048bc817811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:39.772560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99cb67-931d-48db-b43e-b048bc817811 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:39.772837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99cb67-931d-48db-b43e-b048bc817811 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:39.773109 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99cb67-931d-48db-b43e-b048bc817811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:39.782497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99cb67-931d-48db-b43e-b048bc817811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:39.783997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99cb67-931d-48db-b43e-b048bc817811 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:39.795601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1321/2650] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:40.250121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917a8ff-7113-4d63-bf99-e62c129909f1 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:40.251631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f917a8ff-7113-4d63-bf99-e62c129909f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:40.265463 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917a8ff-7113-4d63-bf99-e62c129909f1 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:40.271538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:40.272096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:40.272374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:40.273456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] PATH_INFO: `/v3/projects/40c41530baa84741aa0114aa70c8a45f` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:40.274058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c41530baa84741aa0114aa70c8a45f)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:40.276673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:40.288903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:40.410468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c41530baa84741aa0114aa70c8a45f', 'request_id': 'req-39c5ca5d-ae96-44cf-975c-c013e71951ee'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.459334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c41530baa84741aa0114aa70c8a45f', 'request_id': 'req-39c5ca5d-ae96-44cf-975c-c013e71951ee'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.467649 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c41530baa84741aa0114aa70c8a45f', 'request_id': 'req-39c5ca5d-ae96-44cf-975c-c013e71951ee'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.482177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] The token cache is being invalidate because project 40c41530baa84741aa0114aa70c8a45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:40.482624 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.483958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.486727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1330/2651] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:40 2022] DELETE /identity/v3/projects/40c41530baa84741aa0114aa70c8a45f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:40.491545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99cb67-931d-48db-b43e-b048bc817811 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:40.508269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99cb67-931d-48db-b43e-b048bc817811 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:40.572458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:40.573094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:40.573375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:40.573649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] PATH_INFO: `/v3/users/71a3b61ca9454715ad50240e7b1c3e24` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:40.575047 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a3b61ca9454715ad50240e7b1c3e24)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:40.576968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:40.741257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:40.742874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a3b61ca9454715ad50240e7b1c3e24'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.758619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a3b61ca9454715ad50240e7b1c3e24'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.831638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a3b61ca9454715ad50240e7b1c3e24'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.832364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a3b61ca9454715ad50240e7b1c3e24'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.842311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6fdc7fc4-9f37-40b5-b996-174e329b27bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a3b61ca9454715ad50240e7b1c3e24'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:40.848478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1322/2652] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:40 2022] DELETE /identity/v3/users/71a3b61ca9454715ad50240e7b1c3e24 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:41.332214 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:41.333754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:41.350996 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5ca5d-ae96-44cf-975c-c013e71951ee admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:41.414758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:41.415403 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:41.415682 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:41.415955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] PATH_INFO: `/v3/projects/c2568f9b894d410fa4e72cf64c177929` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:41.417595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2568f9b894d410fa4e72cf64c177929)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:41.419526 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:41.543539 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2568f9b894d410fa4e72cf64c177929', 'request_id': 'req-61bf4390-2baf-4121-949d-cda7aefcd0b5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:41.642975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2568f9b894d410fa4e72cf64c177929', 'request_id': 'req-61bf4390-2baf-4121-949d-cda7aefcd0b5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:41.651559 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2568f9b894d410fa4e72cf64c177929', 'request_id': 'req-61bf4390-2baf-4121-949d-cda7aefcd0b5'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:41.663072 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] The token cache is being invalidate because project c2568f9b894d410fa4e72cf64c177929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:41.663320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:41.664038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-61bf4390-2baf-4121-949d-cda7aefcd0b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:41.665406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1331/2653] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:41 2022] DELETE /identity/v3/projects/c2568f9b894d410fa4e72cf64c177929 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:41.731882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a1cc-b7c3-481b-ba0d-bf108d99393c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:41.732692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a1cc-b7c3-481b-ba0d-bf108d99393c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:41.732692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66a1cc-b7c3-481b-ba0d-bf108d99393c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:41.753875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7e66a1cc-b7c3-481b-ba0d-bf108d99393c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:41.755154 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7e66a1cc-b7c3-481b-ba0d-bf108d99393c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:41.821017 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1323/2654] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:41.828932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3c4be-9ba6-4257-866d-115d98c25fdb None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:41.829216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3c4be-9ba6-4257-866d-115d98c25fdb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:41.829489 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3c4be-9ba6-4257-866d-115d98c25fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:41.850999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-43a3c4be-9ba6-4257-866d-115d98c25fdb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:41.854620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-43a3c4be-9ba6-4257-866d-115d98c25fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:41.861042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1332/2655] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:41.865406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a1cc-b7c3-481b-ba0d-bf108d99393c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:41.875704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66a1cc-b7c3-481b-ba0d-bf108d99393c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:41.880692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:41.881369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:41.881645 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:41.881911 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:41.882608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:46:41.882887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:41.884467 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:41.897968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1324/2656] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:46:41.902963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3c4be-9ba6-4257-866d-115d98c25fdb None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:41.912265 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3c4be-9ba6-4257-866d-115d98c25fdb None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:41.916905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f297ad-1385-4898-8bc5-71dcaed1ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:41.918116 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f297ad-1385-4898-8bc5-71dcaed1ea41 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:41.918394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f297ad-1385-4898-8bc5-71dcaed1ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:41.920152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f297ad-1385-4898-8bc5-71dcaed1ea41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:41.920152 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f297ad-1385-4898-8bc5-71dcaed1ea41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:41.921474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f297ad-1385-4898-8bc5-71dcaed1ea41 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:41.986760 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:41.993238 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1333/2657] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:46:41 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:41.997555 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:42.008486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a95c0-2992-48ea-8d7b-62a2cc965d94 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:42.069451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02b1e0-925b-498d-b390-48d9e810217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:42.070310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b1e0-925b-498d-b390-48d9e810217c admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:42.070558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b1e0-925b-498d-b390-48d9e810217c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:42.071067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b1e0-925b-498d-b390-48d9e810217c admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:42.071655 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02b1e0-925b-498d-b390-48d9e810217c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:42.073590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02b1e0-925b-498d-b390-48d9e810217c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:42.176037 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1325/2658] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:46:41 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:46:42.180478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f297ad-1385-4898-8bc5-71dcaed1ea41 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:42.192120 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f297ad-1385-4898-8bc5-71dcaed1ea41 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:42.197766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b06c7-9d9d-4f47-8b04-0b15d110b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:42.198421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b06c7-9d9d-4f47-8b04-0b15d110b783 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:42.199291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b06c7-9d9d-4f47-8b04-0b15d110b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:42.199703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b06c7-9d9d-4f47-8b04-0b15d110b783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:42.200367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b06c7-9d9d-4f47-8b04-0b15d110b783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:42.202139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b06c7-9d9d-4f47-8b04-0b15d110b783 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:42.212617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1334/2659] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:42.218126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02b1e0-925b-498d-b390-48d9e810217c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:42.228643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02b1e0-925b-498d-b390-48d9e810217c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:42.234226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9219c8f-3208-45a8-aaa7-0467bcb7d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:42.234845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219c8f-3208-45a8-aaa7-0467bcb7d66d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:42.235129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219c8f-3208-45a8-aaa7-0467bcb7d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:42.235404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219c8f-3208-45a8-aaa7-0467bcb7d66d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:42.236054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9219c8f-3208-45a8-aaa7-0467bcb7d66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:42.237807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9219c8f-3208-45a8-aaa7-0467bcb7d66d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:42.249616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1326/2660] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:46:42.257434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b06c7-9d9d-4f47-8b04-0b15d110b783 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:42.271806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b06c7-9d9d-4f47-8b04-0b15d110b783 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:42.277751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:42.282392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:42.282392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:42.282392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] PATH_INFO: `/v3/projects/ace76d00fc1746748b9c1630cc74070b/users/f9ede1b98f2a48b889bb72a42d3dd4cf/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:42.295617 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace76d00fc1746748b9c1630cc74070b, user_id=f9ede1b98f2a48b889bb72a42d3dd4cf, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:42.298361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:42.404365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1335/2661] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:46:42 2022] PUT /identity/v3/projects/ace76d00fc1746748b9c1630cc74070b/users/f9ede1b98f2a48b889bb72a42d3dd4cf/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:42.417719 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69d5b6-83f9-4671-b80a-76ae463afd63 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:42.418526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69d5b6-83f9-4671-b80a-76ae463afd63 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:42.418526 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69d5b6-83f9-4671-b80a-76ae463afd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:42.450583 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9c69d5b6-83f9-4671-b80a-76ae463afd63 None None] MFA Rules not processed for user `f9ede1b98f2a48b889bb72a42d3dd4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:42.451988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9c69d5b6-83f9-4671-b80a-76ae463afd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:42.472590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:42.537429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1327/2662] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:42.548755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:42.551017 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:42.621535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e778377-2df3-46fb-bbcb-2b7c0cd22fbf admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:42.625392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:42.626165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:42.626446 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:42.626721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:42.636014 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:42.638093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:42.648310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1336/2663] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:45.772578 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ff775-3af3-41b9-b7cb-e2b924401c31 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:45.773253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ff775-3af3-41b9-b7cb-e2b924401c31 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:45.773253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ff775-3af3-41b9-b7cb-e2b924401c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:45.798696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-138ff775-3af3-41b9-b7cb-e2b924401c31 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:45.800394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-138ff775-3af3-41b9-b7cb-e2b924401c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:45.882136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1328/2664] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 22 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:45.899003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:45.900574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:45.998256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9b2d5-95dc-4f96-8b98-8e432ba73246 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:46.003771 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27255eb1-2172-46c2-915c-5e9f66dca323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:46.004406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255eb1-2172-46c2-915c-5e9f66dca323 service swift] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:46.004686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255eb1-2172-46c2-915c-5e9f66dca323 service swift] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:46.004969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27255eb1-2172-46c2-915c-5e9f66dca323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:46.016886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27255eb1-2172-46c2-915c-5e9f66dca323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:46.018861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27255eb1-2172-46c2-915c-5e9f66dca323 service swift] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:46.029731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1337/2665] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:46:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:46:47.527946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ff775-3af3-41b9-b7cb-e2b924401c31 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:47.622240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ff775-3af3-41b9-b7cb-e2b924401c31 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:47.636917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:47.636917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:47.636917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:47.636917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] PATH_INFO: `/v3/users/f9ede1b98f2a48b889bb72a42d3dd4cf` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:47.637393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ede1b98f2a48b889bb72a42d3dd4cf)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:47.637393 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:47.837527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ede1b98f2a48b889bb72a42d3dd4cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:47.853237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ede1b98f2a48b889bb72a42d3dd4cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:47.855943 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:47.973361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ede1b98f2a48b889bb72a42d3dd4cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:47.974126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ede1b98f2a48b889bb72a42d3dd4cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:47.982486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ede1b98f2a48b889bb72a42d3dd4cf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:47.988883 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1329/2666] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:46:47 2022] DELETE /identity/v3/users/f9ede1b98f2a48b889bb72a42d3dd4cf => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:46:47.993786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc44d-09d9-484a-8055-19aecf169919 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:47.994374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc44d-09d9-484a-8055-19aecf169919 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:47.994374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbc44d-09d9-484a-8055-19aecf169919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:48.016198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9bfbc44d-09d9-484a-8055-19aecf169919 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:46:48.017799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9bfbc44d-09d9-484a-8055-19aecf169919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:48.088478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:48.102383 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1338/2667] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:46:48.117010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:48.118498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:48.198094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58403a31-8f61-414d-b20b-bd15812ea8bd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:48.202674 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c3fe3-7511-4222-997d-f2f1fe504e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:48.203296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c3fe3-7511-4222-997d-f2f1fe504e52 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:48.203573 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c3fe3-7511-4222-997d-f2f1fe504e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:48.203850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c3fe3-7511-4222-997d-f2f1fe504e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:48.214743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c3fe3-7511-4222-997d-f2f1fe504e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:48.216194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c3fe3-7511-4222-997d-f2f1fe504e52 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:48.228211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1330/2668] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:46:48.684807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbc44d-09d9-484a-8055-19aecf169919 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:46:48.686751 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9bfbc44d-09d9-484a-8055-19aecf169919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:46:48.703694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbc44d-09d9-484a-8055-19aecf169919 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:46:48.713166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:46:48.713166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:46:48.713166 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:46:48.713621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] PATH_INFO: `/v3/projects/ace76d00fc1746748b9c1630cc74070b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:46:48.715143 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace76d00fc1746748b9c1630cc74070b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:46:48.717079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:46:48.839133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace76d00fc1746748b9c1630cc74070b', 'request_id': 'req-215ad9fe-5ffa-4c00-86eb-85193585cf0b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:48.939243 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace76d00fc1746748b9c1630cc74070b', 'request_id': 'req-215ad9fe-5ffa-4c00-86eb-85193585cf0b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:48.949291 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace76d00fc1746748b9c1630cc74070b', 'request_id': 'req-215ad9fe-5ffa-4c00-86eb-85193585cf0b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:48.977073 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] The token cache is being invalidate because project ace76d00fc1746748b9c1630cc74070b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:46:48.977427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:48.979106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-215ad9fe-5ffa-4c00-86eb-85193585cf0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:46:48.981267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1339/2669] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:46:48 2022] DELETE /identity/v3/projects/ace76d00fc1746748b9c1630cc74070b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:46:58.222010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=32 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:46:58.965958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:02.953532 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710430c-199f-4089-8065-c214cf7ebfb4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:02.954170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710430c-199f-4089-8065-c214cf7ebfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:02.954170 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710430c-199f-4089-8065-c214cf7ebfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:02.973312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a710430c-199f-4089-8065-c214cf7ebfb4 None None] MFA Rules not processed for user `076dc430ffdf44aba8eb012f53434a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:47:02.975535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a710430c-199f-4089-8065-c214cf7ebfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:03.031675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1331/2670] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:47:04.363587 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050ece7-f5f1-46bf-9edb-dde390498b98 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:04.364091 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050ece7-f5f1-46bf-9edb-dde390498b98 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:04.364199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050ece7-f5f1-46bf-9edb-dde390498b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:04.386547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a050ece7-f5f1-46bf-9edb-dde390498b98 None None] MFA Rules not processed for user `1b136a57b34c46e6b691d2a24e1288f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:47:04.387803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a050ece7-f5f1-46bf-9edb-dde390498b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:04.448004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1340/2671] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 22 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:47:04.460969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710430c-199f-4089-8065-c214cf7ebfb4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:04.462520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a710430c-199f-4089-8065-c214cf7ebfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:04.547982 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710430c-199f-4089-8065-c214cf7ebfb4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:04.553084 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c5dc-44c4-4916-8d31-7af88be8c999 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d98f829fb354c98a2e170d7f2a00874', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:04.553699 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c5dc-44c4-4916-8d31-7af88be8c999 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:04.553998 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c5dc-44c4-4916-8d31-7af88be8c999 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:04.554291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c5dc-44c4-4916-8d31-7af88be8c999 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:04.564207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c5dc-44c4-4916-8d31-7af88be8c999 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:04.565793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c5dc-44c4-4916-8d31-7af88be8c999 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:04.575322 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1332/2672] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 22 14:47:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 22 14:47:14.441034 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=25 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:14.571063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=57 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:35.677818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050ece7-f5f1-46bf-9edb-dde390498b98 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:35.681897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a050ece7-f5f1-46bf-9edb-dde390498b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:35.737356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050ece7-f5f1-46bf-9edb-dde390498b98 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:35.740918 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:35.741520 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:35.741794 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:35.742104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:35.743805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:35.801368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:35.802834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:35.812293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1341/2673] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:47:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:47:43.790615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c5dc-44c4-4916-8d31-7af88be8c999 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:43.811925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c5dc-44c4-4916-8d31-7af88be8c999 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:43.816642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:43.817577 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:43.820304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:43.820304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:43.820304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:43.951482 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:43.953570 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:43.982496 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1333/2674] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:47:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:47:45.807607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=48 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:48.516330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:48.518194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:48.562188 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048c55-3ebc-4670-a0dc-0a5061be89e7 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:48.566641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:48.567262 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:48.567536 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:48.567804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:48.569586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:48.584094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:48.586505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:48.600939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1342/2675] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:47:52.421012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:52.423658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:52.585238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cc984-38a9-424b-af2a-f2bc3bc52aef service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:52.591723 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:52.592348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:52.593123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:52.593123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:52.595887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:52.605909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:52.609245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:52.611701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:52.621348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:52.623543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:52.633191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1334/2676] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:47:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:47:52.653226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6e5d2-6a01-4809-b383-78281b86e89b service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:52.659730 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:52.659854 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:52.660088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:52.660530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] PATH_INFO: `/v3/users/414e3fa01b5a46b2b3f34934fce8418a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:52.661875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414e3fa01b5a46b2b3f34934fce8418a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:52.663841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:52.895596 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414e3fa01b5a46b2b3f34934fce8418a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:52.896168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414e3fa01b5a46b2b3f34934fce8418a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:52.903008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414e3fa01b5a46b2b3f34934fce8418a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:52.915374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414e3fa01b5a46b2b3f34934fce8418a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:52.916151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414e3fa01b5a46b2b3f34934fce8418a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:52.939598 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:52.941103 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:52.957157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2188d4-5d16-4baa-827d-0016843fc2e9 service placement] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:52.961490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:52.962153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:52.962434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:52.962738 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] PATH_INFO: `/v3/users/2b0375d6cd584faeab759ff9f5cd98f8` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:52.963902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0375d6cd584faeab759ff9f5cd98f8)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:52.965805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:53.002318 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1343/2677] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:47:52 2022] DELETE /identity/v3/users/414e3fa01b5a46b2b3f34934fce8418a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:47:53.141334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0375d6cd584faeab759ff9f5cd98f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.157513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0375d6cd584faeab759ff9f5cd98f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.246803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0375d6cd584faeab759ff9f5cd98f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.247419 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0375d6cd584faeab759ff9f5cd98f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.255792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0375d6cd584faeab759ff9f5cd98f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.267275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1335/2678] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:47:52 2022] DELETE /identity/v3/users/2b0375d6cd584faeab759ff9f5cd98f8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:47:53.267489 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:53.267489 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:53.358431 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cae99-5076-423a-b3f8-bee6b4befc12 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:53.399160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:53.423968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:53.424646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:53.424921 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:53.425200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] PATH_INFO: `/v3/projects/352da357a0624908a914d898e148c534` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:53.426485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] RBAC: Authorizing `identity:delete_project(project_id=352da357a0624908a914d898e148c534)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:53.428426 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:53.574093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:53.575896 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:53.602932 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352da357a0624908a914d898e148c534', 'request_id': 'req-25dff82c-c401-4cb2-a68a-569c55b1757f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.608636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f5dac-e853-44e2-b851-f2a649535ee3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:53.670137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:53.670779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:53.671056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:53.671324 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] PATH_INFO: `/v3/projects/c6d98d531c33471793143c5945f1d3a9` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:53.672549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d98d531c33471793143c5945f1d3a9)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:53.674517 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:53.710159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352da357a0624908a914d898e148c534', 'request_id': 'req-25dff82c-c401-4cb2-a68a-569c55b1757f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.717364 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352da357a0624908a914d898e148c534', 'request_id': 'req-25dff82c-c401-4cb2-a68a-569c55b1757f'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.729068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] The token cache is being invalidate because project 352da357a0624908a914d898e148c534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:47:53.729409 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.730165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.731683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1344/2679] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:47:53 2022] DELETE /identity/v3/projects/352da357a0624908a914d898e148c534 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:47:53.737007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:53.738346 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:53.751819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff82c-c401-4cb2-a68a-569c55b1757f admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:53.756599 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:53.757273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:53.757600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:53.757875 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] PATH_INFO: `/v3/users/431544c260f9452aa494b35f2d090b75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:53.759039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431544c260f9452aa494b35f2d090b75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:53.760956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:53.789225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d98d531c33471793143c5945f1d3a9', 'request_id': 'req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.930745 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d98d531c33471793143c5945f1d3a9', 'request_id': 'req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.937099 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d98d531c33471793143c5945f1d3a9', 'request_id': 'req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.945178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:53.949828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] The token cache is being invalidate because project c6d98d531c33471793143c5945f1d3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:47:53.950134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.950892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-77ec677d-4b45-4eea-a5f8-84ccb1d0aa0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:53.952348 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1336/2680] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:47:53 2022] DELETE /identity/v3/projects/c6d98d531c33471793143c5945f1d3a9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:47:53.958625 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9870e31-fc42-4d75-9a82-80176b0ef73b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:53.958901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9870e31-fc42-4d75-9a82-80176b0ef73b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:53.959174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9870e31-fc42-4d75-9a82-80176b0ef73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.023125 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e9870e31-fc42-4d75-9a82-80176b0ef73b None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:47:54.024461 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e9870e31-fc42-4d75-9a82-80176b0ef73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:54.028924 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431544c260f9452aa494b35f2d090b75'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.030562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431544c260f9452aa494b35f2d090b75'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.041759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431544c260f9452aa494b35f2d090b75'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.056792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431544c260f9452aa494b35f2d090b75'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.059657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431544c260f9452aa494b35f2d090b75'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.098072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1337/2681] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:47:54.104402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0b76d-e6a5-4552-9630-59d3bc5fd5dd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.104692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0b76d-e6a5-4552-9630-59d3bc5fd5dd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.104968 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0b76d-e6a5-4552-9630-59d3bc5fd5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.125766 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-66c0b76d-e6a5-4552-9630-59d3bc5fd5dd None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:47:54.127005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-66c0b76d-e6a5-4552-9630-59d3bc5fd5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:54.135299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1338/2682] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:47:54.139378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0b76d-e6a5-4552-9630-59d3bc5fd5dd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:54.148355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1345/2683] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:47:53 2022] DELETE /identity/v3/users/431544c260f9452aa494b35f2d090b75 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:47:54.148522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0b76d-e6a5-4552-9630-59d3bc5fd5dd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:54.210886 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:54.211497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.211773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.212042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.212741 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:47:54.213044 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:54.214660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:54.230481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1339/2684] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:47:54.231636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:54.243172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cfd31-19ab-46be-803d-2cae63609dd1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:54.248335 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:54.248976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.249260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.250005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.250718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:54.252815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:54.372959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1346/2685] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:47:54 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:47:54.378161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:54.388559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7c5c-775f-46cf-be36-3d7bd6cd702a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:54.405272 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:54.407039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:54.430886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:54.463396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:54.471559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df0eb-1231-4676-bfae-ecffb7a53449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:54.471559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df0eb-1231-4676-bfae-ecffb7a53449 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.471810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df0eb-1231-4676-bfae-ecffb7a53449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.472064 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100df0eb-1231-4676-bfae-ecffb7a53449 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.472749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df0eb-1231-4676-bfae-ecffb7a53449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:54.474687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100df0eb-1231-4676-bfae-ecffb7a53449 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:54.480198 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a060d-fa14-4679-a070-e2acb83c94a5 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:54.487173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:54.487997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.488136 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.488550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] PATH_INFO: `/v3/projects/23dac7b4c3a540d7ac1b52e2448d71f7` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.489758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dac7b4c3a540d7ac1b52e2448d71f7)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:54.491946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:54.590262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1340/2686] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:47:54 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:47:54.590262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df0eb-1231-4676-bfae-ecffb7a53449 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:54.601160 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100df0eb-1231-4676-bfae-ecffb7a53449 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:54.606130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26b1e0-9de8-4371-ab64-6a60648fea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:54.606619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b1e0-9de8-4371-ab64-6a60648fea0c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.606899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b1e0-9de8-4371-ab64-6a60648fea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.607167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b1e0-9de8-4371-ab64-6a60648fea0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.607805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26b1e0-9de8-4371-ab64-6a60648fea0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:54.611302 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26b1e0-9de8-4371-ab64-6a60648fea0c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:54.626641 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1341/2687] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:47:54.630877 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26b1e0-9de8-4371-ab64-6a60648fea0c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:54.634122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dac7b4c3a540d7ac1b52e2448d71f7', 'request_id': 'req-d571e153-f119-4866-a6bf-d18017648475'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.641217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26b1e0-9de8-4371-ab64-6a60648fea0c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:54.699153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a59ba-bdc9-4d9b-9511-479ea582e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:54.699762 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a59ba-bdc9-4d9b-9511-479ea582e5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.700058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a59ba-bdc9-4d9b-9511-479ea582e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.700311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a59ba-bdc9-4d9b-9511-479ea582e5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.700946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a59ba-bdc9-4d9b-9511-479ea582e5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:54.702604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a59ba-bdc9-4d9b-9511-479ea582e5e2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:54.712906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1342/2688] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:47:54.717235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a59ba-bdc9-4d9b-9511-479ea582e5e2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:54.721288 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dac7b4c3a540d7ac1b52e2448d71f7', 'request_id': 'req-d571e153-f119-4866-a6bf-d18017648475'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.727112 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a59ba-bdc9-4d9b-9511-479ea582e5e2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:54.728870 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dac7b4c3a540d7ac1b52e2448d71f7', 'request_id': 'req-d571e153-f119-4866-a6bf-d18017648475'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.731861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:54.732540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.732821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.733090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] PATH_INFO: `/v3/projects/26cf44ec92eb48d98417bdebcc731dee/users/2cb9eb16da184eef9f90c0da96403c53/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.740834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] The token cache is being invalidate because project 23dac7b4c3a540d7ac1b52e2448d71f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:47:54.741128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.741803 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d571e153-f119-4866-a6bf-d18017648475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:47:54.743343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1347/2689] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:47:54 2022] DELETE /identity/v3/projects/23dac7b4c3a540d7ac1b52e2448d71f7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:47:54.749049 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cf44ec92eb48d98417bdebcc731dee, user_id=2cb9eb16da184eef9f90c0da96403c53, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:54.752549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:54.876915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1343/2690] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:47:54 2022] PUT /identity/v3/projects/26cf44ec92eb48d98417bdebcc731dee/users/2cb9eb16da184eef9f90c0da96403c53/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:47:54.882130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6814a-7023-4681-b3a6-284c7bccb1d3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:54.882415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6814a-7023-4681-b3a6-284c7bccb1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:54.882687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6814a-7023-4681-b3a6-284c7bccb1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:54.904046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1bf6814a-7023-4681-b3a6-284c7bccb1d3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:47:54.912499 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1bf6814a-7023-4681-b3a6-284c7bccb1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:54.987442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1348/2691] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:47:54.997696 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:54.999792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:55.060145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b77e38-acc0-4fcf-b226-7c835d5b46b4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:55.064178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:55.072939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:55.072939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:55.072939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:55.074955 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:55.076366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:55.086054 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1344/2692] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:47:56.374174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8fd0c-af84-4950-8778-095ba5945737 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:56.374720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8fd0c-af84-4950-8778-095ba5945737 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:56.374720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8fd0c-af84-4950-8778-095ba5945737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:56.407852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-23c8fd0c-af84-4950-8778-095ba5945737 None None] MFA Rules not processed for user `2cb9eb16da184eef9f90c0da96403c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:47:56.409303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-23c8fd0c-af84-4950-8778-095ba5945737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:56.451439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:56.478508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1349/2693] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:47:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:47:56.483503 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:56.485731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:56.499388 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d8d27-cbe0-4d1e-a8ab-dff79db62946 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:56.504636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d6fa4-09a1-40a9-98c4-a4201e56bae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:56.505177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6fa4-09a1-40a9-98c4-a4201e56bae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:56.505454 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6fa4-09a1-40a9-98c4-a4201e56bae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:56.505722 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6fa4-09a1-40a9-98c4-a4201e56bae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:56.506403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d6fa4-09a1-40a9-98c4-a4201e56bae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:56.508273 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d6fa4-09a1-40a9-98c4-a4201e56bae0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:56.623474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1345/2694] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:47:56 2022] POST /identity/v3/projects => generated 405 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:47:56.627842 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8fd0c-af84-4950-8778-095ba5945737 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:56.638846 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8fd0c-af84-4950-8778-095ba5945737 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:56.696516 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286368ca-8526-4029-a565-894ee8dcd00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:56.697134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286368ca-8526-4029-a565-894ee8dcd00c admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:56.697408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286368ca-8526-4029-a565-894ee8dcd00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:56.697674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286368ca-8526-4029-a565-894ee8dcd00c admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:56.698348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286368ca-8526-4029-a565-894ee8dcd00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:56.700334 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286368ca-8526-4029-a565-894ee8dcd00c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:56.812108 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1350/2695] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:47:56 2022] POST /identity/v3/users => generated 309 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:47:56.816121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d6fa4-09a1-40a9-98c4-a4201e56bae0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:56.827187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d6fa4-09a1-40a9-98c4-a4201e56bae0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:56.833469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748580d3-0cbb-41ab-8f56-aff94968096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:56.834282 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748580d3-0cbb-41ab-8f56-aff94968096d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:56.834626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748580d3-0cbb-41ab-8f56-aff94968096d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:56.834976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748580d3-0cbb-41ab-8f56-aff94968096d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:56.835801 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748580d3-0cbb-41ab-8f56-aff94968096d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:56.837626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748580d3-0cbb-41ab-8f56-aff94968096d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:56.849249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1346/2696] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:47:56.853595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286368ca-8526-4029-a565-894ee8dcd00c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:56.864625 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286368ca-8526-4029-a565-894ee8dcd00c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:56.869415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418e28-be6f-4fd6-83c3-2d749d061c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:56.870185 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418e28-be6f-4fd6-83c3-2d749d061c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:56.870569 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418e28-be6f-4fd6-83c3-2d749d061c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:56.870910 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418e28-be6f-4fd6-83c3-2d749d061c0e admin admin] PATH_INFO: `/v3/projects/be16c2904445449494e3b57c8d00c9e4/users/10bdaf575a624b809e1c8fcf2bbad795/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:56.886483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418e28-be6f-4fd6-83c3-2d749d061c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be16c2904445449494e3b57c8d00c9e4, user_id=10bdaf575a624b809e1c8fcf2bbad795, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:56.889245 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418e28-be6f-4fd6-83c3-2d749d061c0e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:56.965566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1351/2697] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:47:56 2022] PUT /identity/v3/projects/be16c2904445449494e3b57c8d00c9e4/users/10bdaf575a624b809e1c8fcf2bbad795/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:47:56.970113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748580d3-0cbb-41ab-8f56-aff94968096d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:56.980254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748580d3-0cbb-41ab-8f56-aff94968096d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:56.992642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:47:57.038243 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce302e5c-2a4a-421e-b049-b6e4c6e6cdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:57.038848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce302e5c-2a4a-421e-b049-b6e4c6e6cdbd admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:57.039123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce302e5c-2a4a-421e-b049-b6e4c6e6cdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:57.039440 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce302e5c-2a4a-421e-b049-b6e4c6e6cdbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:57.040080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce302e5c-2a4a-421e-b049-b6e4c6e6cdbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:57.041654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce302e5c-2a4a-421e-b049-b6e4c6e6cdbd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:57.052605 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1347/2698] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:47:57.057205 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418e28-be6f-4fd6-83c3-2d749d061c0e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:47:57.068673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418e28-be6f-4fd6-83c3-2d749d061c0e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:47:57.074002 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6100b4-ad5b-4dbe-98d1-b26f8328e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:47:57.074698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6100b4-ad5b-4dbe-98d1-b26f8328e074 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:57.074986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6100b4-ad5b-4dbe-98d1-b26f8328e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:57.075254 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6100b4-ad5b-4dbe-98d1-b26f8328e074 admin admin] PATH_INFO: `/v3/projects/be16c2904445449494e3b57c8d00c9e4/users/10bdaf575a624b809e1c8fcf2bbad795/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:57.077474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6100b4-ad5b-4dbe-98d1-b26f8328e074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be16c2904445449494e3b57c8d00c9e4, user_id=10bdaf575a624b809e1c8fcf2bbad795, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:47:57.084360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6100b4-ad5b-4dbe-98d1-b26f8328e074 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:47:57.093031 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1352/2699] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:47:57 2022] PUT /identity/v3/projects/be16c2904445449494e3b57c8d00c9e4/users/10bdaf575a624b809e1c8fcf2bbad795/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:47:58.724904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eb70d-ad3c-4b84-aaba-e40aa61f2dad None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:47:58.725549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eb70d-ad3c-4b84-aaba-e40aa61f2dad None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:47:58.725549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770eb70d-ad3c-4b84-aaba-e40aa61f2dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:47:58.761792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-770eb70d-ad3c-4b84-aaba-e40aa61f2dad None None] MFA Rules not processed for user `10bdaf575a624b809e1c8fcf2bbad795`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:47:58.763092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-770eb70d-ad3c-4b84-aaba-e40aa61f2dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:47:58.837657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1348/2700] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:00.358920 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6100b4-ad5b-4dbe-98d1-b26f8328e074 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:00.439978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6100b4-ad5b-4dbe-98d1-b26f8328e074 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:00.445012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:00.445772 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:00.446156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:00.446439 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] PATH_INFO: `/v3/users/2cb9eb16da184eef9f90c0da96403c53` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:00.447676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb9eb16da184eef9f90c0da96403c53)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:00.449676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:00.677703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:00.692959 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb9eb16da184eef9f90c0da96403c53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:00.693737 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb9eb16da184eef9f90c0da96403c53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:00.701510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb9eb16da184eef9f90c0da96403c53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:00.715074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb9eb16da184eef9f90c0da96403c53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:00.715814 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb9eb16da184eef9f90c0da96403c53'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:00.824474 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1353/2701] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:00 2022] DELETE /identity/v3/users/2cb9eb16da184eef9f90c0da96403c53 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:01.077203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eb70d-ad3c-4b84-aaba-e40aa61f2dad None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:01.089926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770eb70d-ad3c-4b84-aaba-e40aa61f2dad None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:01.151309 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:01.151953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:01.152240 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:01.152515 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] PATH_INFO: `/v3/projects/26cf44ec92eb48d98417bdebcc731dee` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:01.153670 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cf44ec92eb48d98417bdebcc731dee)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:01.155698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:01.266502 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:01.274285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cf44ec92eb48d98417bdebcc731dee', 'request_id': 'req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.347869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cf44ec92eb48d98417bdebcc731dee', 'request_id': 'req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.360215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cf44ec92eb48d98417bdebcc731dee', 'request_id': 'req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.366353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] The token cache is being invalidate because project 26cf44ec92eb48d98417bdebcc731dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:01.366643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.367296 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.368782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1349/2702] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:01 2022] DELETE /identity/v3/projects/26cf44ec92eb48d98417bdebcc731dee => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:01.373001 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:01.374508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:01.388093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba31f2d-1796-48c2-913a-92222483f672 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:01.444775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:01.445419 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:01.445700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:01.445970 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] PATH_INFO: `/v3/users/10bdaf575a624b809e1c8fcf2bbad795` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:01.447153 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10bdaf575a624b809e1c8fcf2bbad795)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:01.449085 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:01.655360 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bdaf575a624b809e1c8fcf2bbad795'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.656040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bdaf575a624b809e1c8fcf2bbad795'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.664054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bdaf575a624b809e1c8fcf2bbad795'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.677142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bdaf575a624b809e1c8fcf2bbad795'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.677905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a6c39358-936c-42c7-b192-04b1c3cdf951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bdaf575a624b809e1c8fcf2bbad795'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:01.759780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1354/2703] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:01 2022] DELETE /identity/v3/users/10bdaf575a624b809e1c8fcf2bbad795 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:02.011590 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:02.014173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:02.031247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ddaf8-66bd-475e-8106-c0a60fd2aed4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:02.097697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:02.098473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:02.098645 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:02.098918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] PATH_INFO: `/v3/projects/be16c2904445449494e3b57c8d00c9e4` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:02.100108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be16c2904445449494e3b57c8d00c9e4)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:02.102028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:02.258480 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be16c2904445449494e3b57c8d00c9e4', 'request_id': 'req-1cee86fd-778b-4ae1-86fa-33bf716503e6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:02.359344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be16c2904445449494e3b57c8d00c9e4', 'request_id': 'req-1cee86fd-778b-4ae1-86fa-33bf716503e6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:02.366724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be16c2904445449494e3b57c8d00c9e4', 'request_id': 'req-1cee86fd-778b-4ae1-86fa-33bf716503e6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:02.379832 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] The token cache is being invalidate because project be16c2904445449494e3b57c8d00c9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:02.380121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:02.380871 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1cee86fd-778b-4ae1-86fa-33bf716503e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:02.382834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1350/2704] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:02 2022] DELETE /identity/v3/projects/be16c2904445449494e3b57c8d00c9e4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:02.387568 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c31c-8276-4f14-be64-1130d31d5e4e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:02.388093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c31c-8276-4f14-be64-1130d31d5e4e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:02.388204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c31c-8276-4f14-be64-1130d31d5e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:02.529030 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1503c31c-8276-4f14-be64-1130d31d5e4e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:02.530203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1503c31c-8276-4f14-be64-1130d31d5e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:02.557434 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:02.592109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1355/2705] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:02.600560 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9bfd-b1ea-4ac0-8612-dc87b5af78b5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:02.600843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9bfd-b1ea-4ac0-8612-dc87b5af78b5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:02.601116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9bfd-b1ea-4ac0-8612-dc87b5af78b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:02.622184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fbcf9bfd-b1ea-4ac0-8612-dc87b5af78b5 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:02.623442 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fbcf9bfd-b1ea-4ac0-8612-dc87b5af78b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:02.632474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1351/2706] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:02.636895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c31c-8276-4f14-be64-1130d31d5e4e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:02.648227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c31c-8276-4f14-be64-1130d31d5e4e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:02.653021 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:02.653631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:02.653915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:02.654241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:02.654897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:48:02.655203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:02.657068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:02.669586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1356/2707] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:48:02.674459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9bfd-b1ea-4ac0-8612-dc87b5af78b5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:02.684362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9bfd-b1ea-4ac0-8612-dc87b5af78b5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:02.689572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abfdb-b880-491f-90a4-34bbe7e4a96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:02.690210 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abfdb-b880-491f-90a4-34bbe7e4a96b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:02.690494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abfdb-b880-491f-90a4-34bbe7e4a96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:02.690790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485abfdb-b880-491f-90a4-34bbe7e4a96b admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:02.691651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485abfdb-b880-491f-90a4-34bbe7e4a96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:02.693602 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485abfdb-b880-491f-90a4-34bbe7e4a96b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:02.781177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1352/2708] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:02 2022] POST /identity/v3/projects => generated 355 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:02.784960 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:02.795159 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa30f3-4055-4676-8fae-a8405e440f40 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:02.857472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b34d-acf4-4293-8093-2b0ae9cd9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:02.871869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b34d-acf4-4293-8093-2b0ae9cd9f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:02.871869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b34d-acf4-4293-8093-2b0ae9cd9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:02.871869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4b34d-acf4-4293-8093-2b0ae9cd9f85 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:02.871869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4b34d-acf4-4293-8093-2b0ae9cd9f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:02.871869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4b34d-acf4-4293-8093-2b0ae9cd9f85 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:02.983174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1357/2709] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:02 2022] POST /identity/v3/users => generated 278 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:02.988184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abfdb-b880-491f-90a4-34bbe7e4a96b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:02.999335 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485abfdb-b880-491f-90a4-34bbe7e4a96b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:03.004901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d95a6-5b80-43fa-8f0b-122a1d743660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:03.005569 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d95a6-5b80-43fa-8f0b-122a1d743660 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:03.005845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d95a6-5b80-43fa-8f0b-122a1d743660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:03.006147 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d95a6-5b80-43fa-8f0b-122a1d743660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:03.006795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d95a6-5b80-43fa-8f0b-122a1d743660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:03.008390 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d95a6-5b80-43fa-8f0b-122a1d743660 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:03.019572 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1353/2710] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:48:03.023775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b34d-acf4-4293-8093-2b0ae9cd9f85 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:03.034392 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4b34d-acf4-4293-8093-2b0ae9cd9f85 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:03.039126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a855945-b76c-48a5-93d6-474782632aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:03.039729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a855945-b76c-48a5-93d6-474782632aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:03.040012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a855945-b76c-48a5-93d6-474782632aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:03.040295 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a855945-b76c-48a5-93d6-474782632aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:03.040999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a855945-b76c-48a5-93d6-474782632aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:03.042648 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a855945-b76c-48a5-93d6-474782632aa2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:03.053789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1358/2711] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:03.058004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d95a6-5b80-43fa-8f0b-122a1d743660 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:03.069112 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d95a6-5b80-43fa-8f0b-122a1d743660 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:03.073865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8562fec-44f5-4719-9933-3466cba04f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:03.074650 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8562fec-44f5-4719-9933-3466cba04f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:03.074938 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8562fec-44f5-4719-9933-3466cba04f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:03.075215 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8562fec-44f5-4719-9933-3466cba04f80 admin admin] PATH_INFO: `/v3/projects/f17c2587de614c4f8e0389ee72319f3f/users/74097b02730d4a72867dde83c2dcb9da/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:03.090386 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8562fec-44f5-4719-9933-3466cba04f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17c2587de614c4f8e0389ee72319f3f, user_id=74097b02730d4a72867dde83c2dcb9da, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:03.092997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8562fec-44f5-4719-9933-3466cba04f80 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:03.095978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:03.213562 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1354/2712] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:03 2022] PUT /identity/v3/projects/f17c2587de614c4f8e0389ee72319f3f/users/74097b02730d4a72867dde83c2dcb9da/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:03.225995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51fbf9-419c-40fb-ac89-0a6e18074fb3 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:03.226297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51fbf9-419c-40fb-ac89-0a6e18074fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:03.226574 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51fbf9-419c-40fb-ac89-0a6e18074fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:03.256634 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-af51fbf9-419c-40fb-ac89-0a6e18074fb3 None None] MFA Rules not processed for user `74097b02730d4a72867dde83c2dcb9da`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:03.257894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-af51fbf9-419c-40fb-ac89-0a6e18074fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:03.322522 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1359/2713] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:03.327521 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8562fec-44f5-4719-9933-3466cba04f80 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:03.393819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8562fec-44f5-4719-9933-3466cba04f80 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:03.398586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ce1c-3653-4af0-8e98-2883207cb6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:03.399192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ce1c-3653-4af0-8e98-2883207cb6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:03.399468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ce1c-3653-4af0-8e98-2883207cb6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:03.399736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ce1c-3653-4af0-8e98-2883207cb6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:03.400384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ce1c-3653-4af0-8e98-2883207cb6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:03.402292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ce1c-3653-4af0-8e98-2883207cb6c0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:03.546133 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1355/2714] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:03 2022] POST /identity/v3/projects => generated 355 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:48:03.550354 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51fbf9-419c-40fb-ac89-0a6e18074fb3 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:03.561353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51fbf9-419c-40fb-ac89-0a6e18074fb3 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:03.581533 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:03.618680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddf31c-c89b-4f1a-8970-4ec43eab5bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:03.619321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf31c-c89b-4f1a-8970-4ec43eab5bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:03.619613 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf31c-c89b-4f1a-8970-4ec43eab5bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:03.619889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf31c-c89b-4f1a-8970-4ec43eab5bdc admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:03.620555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddf31c-c89b-4f1a-8970-4ec43eab5bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:03.622496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddf31c-c89b-4f1a-8970-4ec43eab5bdc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:03.744216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1360/2715] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:03 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:03.748291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ce1c-3653-4af0-8e98-2883207cb6c0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:03.758603 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ce1c-3653-4af0-8e98-2883207cb6c0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:03.763187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e0d56-ff00-4dbe-aed3-3677d7873bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:03.763784 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e0d56-ff00-4dbe-aed3-3677d7873bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:03.764063 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e0d56-ff00-4dbe-aed3-3677d7873bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:03.764337 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e0d56-ff00-4dbe-aed3-3677d7873bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:03.764973 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e0d56-ff00-4dbe-aed3-3677d7873bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:03.767134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e0d56-ff00-4dbe-aed3-3677d7873bcc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:03.777873 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1356/2716] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:03.782834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddf31c-c89b-4f1a-8970-4ec43eab5bdc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:03.792983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddf31c-c89b-4f1a-8970-4ec43eab5bdc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:03.797755 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862530f5-f270-4f9f-943c-f91847b091d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:03.798461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862530f5-f270-4f9f-943c-f91847b091d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:03.798744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862530f5-f270-4f9f-943c-f91847b091d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:03.799015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862530f5-f270-4f9f-943c-f91847b091d9 admin admin] PATH_INFO: `/v3/projects/8d00fa5b7f354f97a6ea15241c20e944/users/65bc3316a9ba46568b4aff4d28903602/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:03.814797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862530f5-f270-4f9f-943c-f91847b091d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d00fa5b7f354f97a6ea15241c20e944, user_id=65bc3316a9ba46568b4aff4d28903602, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:03.817405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862530f5-f270-4f9f-943c-f91847b091d9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:03.937246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1361/2717] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:03 2022] PUT /identity/v3/projects/8d00fa5b7f354f97a6ea15241c20e944/users/65bc3316a9ba46568b4aff4d28903602/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:03.941773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e0d56-ff00-4dbe-aed3-3677d7873bcc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:03.952062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e0d56-ff00-4dbe-aed3-3677d7873bcc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:04.020310 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7692d0b-8636-4f0d-80c3-15c0a8187a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:04.020969 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7692d0b-8636-4f0d-80c3-15c0a8187a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:04.021251 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7692d0b-8636-4f0d-80c3-15c0a8187a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:04.021524 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7692d0b-8636-4f0d-80c3-15c0a8187a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:04.022288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7692d0b-8636-4f0d-80c3-15c0a8187a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:04.025815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7692d0b-8636-4f0d-80c3-15c0a8187a40 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:04.040682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1357/2718] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:04.042411 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862530f5-f270-4f9f-943c-f91847b091d9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:04.053778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862530f5-f270-4f9f-943c-f91847b091d9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:04.058952 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:04.059641 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:04.060061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:04.060257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] PATH_INFO: `/v3/projects/8d00fa5b7f354f97a6ea15241c20e944/users/65bc3316a9ba46568b4aff4d28903602/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:04.067462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d00fa5b7f354f97a6ea15241c20e944, user_id=65bc3316a9ba46568b4aff4d28903602, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:04.070324 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:04.082655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1362/2719] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:04 2022] PUT /identity/v3/projects/8d00fa5b7f354f97a6ea15241c20e944/users/65bc3316a9ba46568b4aff4d28903602/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:04.097486 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ac22-0e4e-43b2-a127-03f568116bd6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:04.097769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ac22-0e4e-43b2-a127-03f568116bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:04.098152 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ac22-0e4e-43b2-a127-03f568116bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:04.131700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7797ac22-0e4e-43b2-a127-03f568116bd6 None None] MFA Rules not processed for user `65bc3316a9ba46568b4aff4d28903602`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:04.132939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7797ac22-0e4e-43b2-a127-03f568116bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:04.193078 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:04.215067 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1358/2720] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:04.229688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:04.231462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:04.293969 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8a24d-e0a7-4236-874a-f05e9bf87009 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:04.298358 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:04.298982 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:04.299261 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:04.299534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:04.310643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:04.312298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:04.323180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1363/2721] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:04.581104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ac22-0e4e-43b2-a127-03f568116bd6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:04.591208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ac22-0e4e-43b2-a127-03f568116bd6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:04.595477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914adac3-0c4c-4dc9-a720-3e00478ffacc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:04.596090 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914adac3-0c4c-4dc9-a720-3e00478ffacc service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:04.596371 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914adac3-0c4c-4dc9-a720-3e00478ffacc service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:04.596643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914adac3-0c4c-4dc9-a720-3e00478ffacc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:04.659852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914adac3-0c4c-4dc9-a720-3e00478ffacc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:04.661311 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914adac3-0c4c-4dc9-a720-3e00478ffacc service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:04.671167 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1359/2722] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:06.355322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:06.356840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:06.434473 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8628db-9f08-479a-a6ae-d4a147dfe28b service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:06.442215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:06.443229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:06.443507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:06.443770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:06.445692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:06.459478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:06.461174 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:06.474293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1364/2723] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:11.178186 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141ac28-6537-4772-b842-0db7e89da32e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:11.178700 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141ac28-6537-4772-b842-0db7e89da32e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:11.178804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141ac28-6537-4772-b842-0db7e89da32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:11.199501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5141ac28-6537-4772-b842-0db7e89da32e None None] MFA Rules not processed for user `076dc430ffdf44aba8eb012f53434a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:11.200726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5141ac28-6537-4772-b842-0db7e89da32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:11.261075 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1360/2724] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:16.469196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:21.254369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=58 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:24.335293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:24.399012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a25c3-f9d2-4bab-b3f4-4492bb2e81ec service placement] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:24.403602 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:24.404249 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:24.404522 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:24.404791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] PATH_INFO: `/v3/users/74097b02730d4a72867dde83c2dcb9da` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:24.406149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74097b02730d4a72867dde83c2dcb9da)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:24.408267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:24.612859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74097b02730d4a72867dde83c2dcb9da'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:24.613432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74097b02730d4a72867dde83c2dcb9da'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:24.620607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74097b02730d4a72867dde83c2dcb9da'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:24.633321 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74097b02730d4a72867dde83c2dcb9da'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:24.634046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74097b02730d4a72867dde83c2dcb9da'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:24.701590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1365/2725] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:24 2022] DELETE /identity/v3/users/74097b02730d4a72867dde83c2dcb9da => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:24.707194 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d769-4ab4-4c8c-87d7-2e9401e8e3e6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:24.707754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d769-4ab4-4c8c-87d7-2e9401e8e3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:24.707754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7d769-4ab4-4c8c-87d7-2e9401e8e3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:24.727693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e4a7d769-4ab4-4c8c-87d7-2e9401e8e3e6 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:24.728905 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e4a7d769-4ab4-4c8c-87d7-2e9401e8e3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:24.791884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1361/2726] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:24.802082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:24.803611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:24.891582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72123-1fa6-4f8f-a06a-93f541903da9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:24.895578 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6652f8b-1840-4831-908c-c5955950de88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:24.896201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652f8b-1840-4831-908c-c5955950de88 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:24.896481 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652f8b-1840-4831-908c-c5955950de88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:24.896766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6652f8b-1840-4831-908c-c5955950de88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:24.907805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6652f8b-1840-4831-908c-c5955950de88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:24.909256 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6652f8b-1840-4831-908c-c5955950de88 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:24.919860 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1366/2727] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:25.438338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7d769-4ab4-4c8c-87d7-2e9401e8e3e6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:25.439895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e4a7d769-4ab4-4c8c-87d7-2e9401e8e3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:25.454678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7d769-4ab4-4c8c-87d7-2e9401e8e3e6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:25.459756 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:25.460416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:25.461501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:25.461782 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] PATH_INFO: `/v3/projects/f17c2587de614c4f8e0389ee72319f3f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:25.463316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17c2587de614c4f8e0389ee72319f3f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:25.465264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:25.580836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17c2587de614c4f8e0389ee72319f3f', 'request_id': 'req-1dfe06b5-2c76-4372-bb8e-31eca1a57455'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.652528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17c2587de614c4f8e0389ee72319f3f', 'request_id': 'req-1dfe06b5-2c76-4372-bb8e-31eca1a57455'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.661101 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17c2587de614c4f8e0389ee72319f3f', 'request_id': 'req-1dfe06b5-2c76-4372-bb8e-31eca1a57455'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.674731 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] The token cache is being invalidate because project f17c2587de614c4f8e0389ee72319f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:25.675024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.675697 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.677193 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1362/2728] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:25 2022] DELETE /identity/v3/projects/f17c2587de614c4f8e0389ee72319f3f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:25.681276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6652f8b-1840-4831-908c-c5955950de88 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:25.686466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:25.692190 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6652f8b-1840-4831-908c-c5955950de88 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:25.750934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:25.751579 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:25.751858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:25.752131 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] PATH_INFO: `/v3/users/65bc3316a9ba46568b4aff4d28903602` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:25.753279 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65bc3316a9ba46568b4aff4d28903602)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:25.755517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:25.946268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65bc3316a9ba46568b4aff4d28903602'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.946934 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65bc3316a9ba46568b4aff4d28903602'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.953906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65bc3316a9ba46568b4aff4d28903602'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.965269 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65bc3316a9ba46568b4aff4d28903602'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:25.965945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-ba237341-d8cf-4eb6-a510-67ce74b4edc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65bc3316a9ba46568b4aff4d28903602'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:26.045470 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1367/2729] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:25 2022] DELETE /identity/v3/users/65bc3316a9ba46568b4aff4d28903602 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:26.612828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:26.618765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:26.630708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe06b5-2c76-4372-bb8e-31eca1a57455 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:26.698552 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:26.699525 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:26.699809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:26.700088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] PATH_INFO: `/v3/projects/8d00fa5b7f354f97a6ea15241c20e944` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:26.701478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d00fa5b7f354f97a6ea15241c20e944)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:26.704143 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:26.800952 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:26.819539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d00fa5b7f354f97a6ea15241c20e944', 'request_id': 'req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:26.896826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d00fa5b7f354f97a6ea15241c20e944', 'request_id': 'req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:26.904226 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d00fa5b7f354f97a6ea15241c20e944', 'request_id': 'req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:26.916813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] The token cache is being invalidate because project 8d00fa5b7f354f97a6ea15241c20e944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:26.917080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:26.917680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d7e3da2-52c1-4f8d-8ab1-a00da1bcd8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:26.919924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1363/2730] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:26 2022] DELETE /identity/v3/projects/8d00fa5b7f354f97a6ea15241c20e944 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:26.924743 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6697a3-8e2f-43cd-b9f9-15a5a91e4578 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:26.925271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6697a3-8e2f-43cd-b9f9-15a5a91e4578 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:26.925271 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6697a3-8e2f-43cd-b9f9-15a5a91e4578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:26.946144 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-de6697a3-8e2f-43cd-b9f9-15a5a91e4578 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:26.947674 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-de6697a3-8e2f-43cd-b9f9-15a5a91e4578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:27.032950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1368/2731] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:27.042209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2e51-51ba-47fc-babd-a6a62e05ac8c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.042752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2e51-51ba-47fc-babd-a6a62e05ac8c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.043787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f2e51-51ba-47fc-babd-a6a62e05ac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.066588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f77f2e51-51ba-47fc-babd-a6a62e05ac8c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:27.067895 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f77f2e51-51ba-47fc-babd-a6a62e05ac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:27.078884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1364/2732] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:27.084071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6697a3-8e2f-43cd-b9f9-15a5a91e4578 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:27.096302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6697a3-8e2f-43cd-b9f9-15a5a91e4578 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:27.101631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:27.102348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.102623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.102892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.103572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:48:27.103872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:27.105616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:27.120362 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1369/2733] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:48:27.124958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f2e51-51ba-47fc-babd-a6a62e05ac8c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:27.135464 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f2e51-51ba-47fc-babd-a6a62e05ac8c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:27.142330 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c018a3-34cd-412a-9e73-7768401875a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:27.142976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c018a3-34cd-412a-9e73-7768401875a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.143349 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c018a3-34cd-412a-9e73-7768401875a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.143643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c018a3-34cd-412a-9e73-7768401875a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.144316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c018a3-34cd-412a-9e73-7768401875a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:27.146477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c018a3-34cd-412a-9e73-7768401875a9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:27.288796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1365/2734] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:27 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:27.292721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:27.306242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7514d30-7adb-4b65-86b7-8cdb0d4b4259 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:27.314327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:27.373905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5651f5d-9a4e-4e9f-a185-415dbede7e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:27.376068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651f5d-9a4e-4e9f-a185-415dbede7e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.376068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651f5d-9a4e-4e9f-a185-415dbede7e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.376068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651f5d-9a4e-4e9f-a185-415dbede7e7e admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.376567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5651f5d-9a4e-4e9f-a185-415dbede7e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:27.378518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5651f5d-9a4e-4e9f-a185-415dbede7e7e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:27.487920 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1370/2735] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:27 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:27.493150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c018a3-34cd-412a-9e73-7768401875a9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:27.504831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c018a3-34cd-412a-9e73-7768401875a9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:27.510192 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47689-f779-4f7b-a8a1-21a3e0fa94c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:27.510819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47689-f779-4f7b-a8a1-21a3e0fa94c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.511094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47689-f779-4f7b-a8a1-21a3e0fa94c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.511361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f47689-f779-4f7b-a8a1-21a3e0fa94c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.512164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f47689-f779-4f7b-a8a1-21a3e0fa94c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:27.513765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f47689-f779-4f7b-a8a1-21a3e0fa94c6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:27.531596 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1366/2736] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:27.531792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5651f5d-9a4e-4e9f-a185-415dbede7e7e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:27.541208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5651f5d-9a4e-4e9f-a185-415dbede7e7e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:27.546150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b352f-99df-4617-b24f-4bd9a4e6442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:27.547546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b352f-99df-4617-b24f-4bd9a4e6442a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.547826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b352f-99df-4617-b24f-4bd9a4e6442a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.548101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b352f-99df-4617-b24f-4bd9a4e6442a admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.548763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b352f-99df-4617-b24f-4bd9a4e6442a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:27.550450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b352f-99df-4617-b24f-4bd9a4e6442a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:27.564005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1371/2737] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:27.568214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47689-f779-4f7b-a8a1-21a3e0fa94c6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:27.579012 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f47689-f779-4f7b-a8a1-21a3e0fa94c6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:27.583740 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89508b51-762f-4b37-ab7e-704ff99684ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:27.584400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508b51-762f-4b37-ab7e-704ff99684ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.584679 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508b51-762f-4b37-ab7e-704ff99684ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.584954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89508b51-762f-4b37-ab7e-704ff99684ce admin admin] PATH_INFO: `/v3/projects/1af616c3a09547139caad766c911d055/users/949bfb818ff6459fa20bcde95543946a/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.602834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89508b51-762f-4b37-ab7e-704ff99684ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af616c3a09547139caad766c911d055, user_id=949bfb818ff6459fa20bcde95543946a, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:27.605567 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89508b51-762f-4b37-ab7e-704ff99684ce admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:27.690558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1367/2738] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:27 2022] PUT /identity/v3/projects/1af616c3a09547139caad766c911d055/users/949bfb818ff6459fa20bcde95543946a/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:27.701104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a889c-d66a-4bbc-81b5-499c35d2146c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.701389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a889c-d66a-4bbc-81b5-499c35d2146c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.701690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a889c-d66a-4bbc-81b5-499c35d2146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.730066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d94a889c-d66a-4bbc-81b5-499c35d2146c None None] MFA Rules not processed for user `949bfb818ff6459fa20bcde95543946a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:27.731306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d94a889c-d66a-4bbc-81b5-499c35d2146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:27.800919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1372/2739] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:27.805658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89508b51-762f-4b37-ab7e-704ff99684ce admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:27.871827 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89508b51-762f-4b37-ab7e-704ff99684ce admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:27.876980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02009cef-d30d-4b22-8203-4bf101120606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:27.877587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02009cef-d30d-4b22-8203-4bf101120606 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:27.877864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02009cef-d30d-4b22-8203-4bf101120606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:27.878168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02009cef-d30d-4b22-8203-4bf101120606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:27.878815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02009cef-d30d-4b22-8203-4bf101120606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:27.880855 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02009cef-d30d-4b22-8203-4bf101120606 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:27.977744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1368/2740] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:27 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:27.981906 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a889c-d66a-4bbc-81b5-499c35d2146c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:27.992825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a889c-d66a-4bbc-81b5-499c35d2146c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:28.055786 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e96c-bc5c-4782-8ee5-834406a018f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:28.056315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e96c-bc5c-4782-8ee5-834406a018f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:28.056592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e96c-bc5c-4782-8ee5-834406a018f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:28.056862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e96c-bc5c-4782-8ee5-834406a018f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:28.057756 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e96c-bc5c-4782-8ee5-834406a018f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:28.059692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e96c-bc5c-4782-8ee5-834406a018f7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:28.147703 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1373/2741] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:27 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:28.151964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02009cef-d30d-4b22-8203-4bf101120606 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:28.163617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02009cef-d30d-4b22-8203-4bf101120606 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:28.168368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fe984-5ad1-4902-8e8d-41e326e48438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:28.168971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fe984-5ad1-4902-8e8d-41e326e48438 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:28.169254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fe984-5ad1-4902-8e8d-41e326e48438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:28.169531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fe984-5ad1-4902-8e8d-41e326e48438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:28.170213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fe984-5ad1-4902-8e8d-41e326e48438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:28.171967 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fe984-5ad1-4902-8e8d-41e326e48438 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:28.183020 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1369/2742] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:28.187202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e96c-bc5c-4782-8ee5-834406a018f7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:28.197576 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e96c-bc5c-4782-8ee5-834406a018f7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:28.202258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5aeb-f417-4fbf-ad25-6ae3e4a61968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:28.203396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5aeb-f417-4fbf-ad25-6ae3e4a61968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:28.203671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5aeb-f417-4fbf-ad25-6ae3e4a61968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:28.203945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a5aeb-f417-4fbf-ad25-6ae3e4a61968 admin admin] PATH_INFO: `/v3/projects/89580c87803a485081af31c19444667a/users/82d4c2a2855649eba65a7bf352e3433e/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:28.206302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:28.220232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5aeb-f417-4fbf-ad25-6ae3e4a61968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89580c87803a485081af31c19444667a, user_id=82d4c2a2855649eba65a7bf352e3433e, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:28.222864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a5aeb-f417-4fbf-ad25-6ae3e4a61968 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:28.307277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1374/2743] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:28 2022] PUT /identity/v3/projects/89580c87803a485081af31c19444667a/users/82d4c2a2855649eba65a7bf352e3433e/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:28.311475 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fe984-5ad1-4902-8e8d-41e326e48438 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:28.322500 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fe984-5ad1-4902-8e8d-41e326e48438 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:28.344727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:28.382134 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e3da2-9cfc-45dd-bfa1-17abc9f344ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:28.382742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3da2-9cfc-45dd-bfa1-17abc9f344ee admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:28.383019 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3da2-9cfc-45dd-bfa1-17abc9f344ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:28.383290 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3da2-9cfc-45dd-bfa1-17abc9f344ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:28.383924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e3da2-9cfc-45dd-bfa1-17abc9f344ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:28.385497 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e3da2-9cfc-45dd-bfa1-17abc9f344ee admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:28.396094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1370/2744] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:28.400328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5aeb-f417-4fbf-ad25-6ae3e4a61968 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:28.411127 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a5aeb-f417-4fbf-ad25-6ae3e4a61968 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:28.415858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:28.416550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:28.416828 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:28.417101 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] PATH_INFO: `/v3/projects/89580c87803a485081af31c19444667a/users/82d4c2a2855649eba65a7bf352e3433e/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:28.419094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89580c87803a485081af31c19444667a, user_id=82d4c2a2855649eba65a7bf352e3433e, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:28.422227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:28.433476 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1375/2745] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:28 2022] PUT /identity/v3/projects/89580c87803a485081af31c19444667a/users/82d4c2a2855649eba65a7bf352e3433e/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:28.444552 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2375-28ab-4638-9c9a-233f2a8d8d48 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:28.444836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2375-28ab-4638-9c9a-233f2a8d8d48 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:28.445116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2375-28ab-4638-9c9a-233f2a8d8d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:28.477900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-14af2375-28ab-4638-9c9a-233f2a8d8d48 None None] MFA Rules not processed for user `82d4c2a2855649eba65a7bf352e3433e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:28.479164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-14af2375-28ab-4638-9c9a-233f2a8d8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:28.555334 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1371/2746] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:28.568696 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:28.570438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:28.652915 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e717e6-7f1a-4e55-8333-7d49f6788ea6 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:28.657582 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbec88f-b6e4-47be-b4d5-29518127bca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:28.657895 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbec88f-b6e4-47be-b4d5-29518127bca4 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:28.658209 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbec88f-b6e4-47be-b4d5-29518127bca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:28.658480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbec88f-b6e4-47be-b4d5-29518127bca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:28.667690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbec88f-b6e4-47be-b4d5-29518127bca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:28.669150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbec88f-b6e4-47be-b4d5-29518127bca4 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:28.679621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1376/2747] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:48:28.847974 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2375-28ab-4638-9c9a-233f2a8d8d48 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:28.849383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-14af2375-28ab-4638-9c9a-233f2a8d8d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:28.862843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2375-28ab-4638-9c9a-233f2a8d8d48 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:28.866519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea1d52-c94f-418d-9975-809db7c742e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:28.867126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea1d52-c94f-418d-9975-809db7c742e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:28.867403 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea1d52-c94f-418d-9975-809db7c742e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:28.867671 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea1d52-c94f-418d-9975-809db7c742e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:28.927401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea1d52-c94f-418d-9975-809db7c742e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:28.928843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea1d52-c94f-418d-9975-809db7c742e2 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:28.939501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1372/2748] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:34.037122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbec88f-b6e4-47be-b4d5-29518127bca4 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:34.122876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbec88f-b6e4-47be-b4d5-29518127bca4 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:34.128606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:34.129262 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:34.129540 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:34.129813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] PATH_INFO: `/v3/users/949bfb818ff6459fa20bcde95543946a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:34.131094 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=949bfb818ff6459fa20bcde95543946a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:34.133049 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:34.353902 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949bfb818ff6459fa20bcde95543946a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:34.354537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949bfb818ff6459fa20bcde95543946a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:34.361290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:34.365086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949bfb818ff6459fa20bcde95543946a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:34.386250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949bfb818ff6459fa20bcde95543946a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:34.387327 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949bfb818ff6459fa20bcde95543946a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:34.468796 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1377/2749] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:34 2022] DELETE /identity/v3/users/949bfb818ff6459fa20bcde95543946a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:34.474294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d712-2bec-4a3f-bb95-7cf1b2d4bf12 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:34.479161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d712-2bec-4a3f-bb95-7cf1b2d4bf12 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:34.479161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13d712-2bec-4a3f-bb95-7cf1b2d4bf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:34.495922 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3f13d712-2bec-4a3f-bb95-7cf1b2d4bf12 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:34.497158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3f13d712-2bec-4a3f-bb95-7cf1b2d4bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:34.543544 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:34.567733 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1373/2750] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:34.578845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:34.580317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:34.647308 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588b1e-d5c8-4e28-983a-d757a73f6d9d admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:34.651867 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78559d0f-fa7d-41c3-9cc6-a9d382513d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:34.652613 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78559d0f-fa7d-41c3-9cc6-a9d382513d5e service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:34.652938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78559d0f-fa7d-41c3-9cc6-a9d382513d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:34.653257 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78559d0f-fa7d-41c3-9cc6-a9d382513d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:34.665146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78559d0f-fa7d-41c3-9cc6-a9d382513d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:34.666694 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78559d0f-fa7d-41c3-9cc6-a9d382513d5e service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:34.679024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1378/2751] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:48:35.168103 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13d712-2bec-4a3f-bb95-7cf1b2d4bf12 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:35.169682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3f13d712-2bec-4a3f-bb95-7cf1b2d4bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:35.183956 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13d712-2bec-4a3f-bb95-7cf1b2d4bf12 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:35.189514 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:35.190246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:35.190529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:35.190808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] PATH_INFO: `/v3/projects/1af616c3a09547139caad766c911d055` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:35.192121 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af616c3a09547139caad766c911d055)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:35.194150 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:35.323890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af616c3a09547139caad766c911d055', 'request_id': 'req-252f42fc-ff54-428e-b0f3-be6c512e81f1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.404318 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af616c3a09547139caad766c911d055', 'request_id': 'req-252f42fc-ff54-428e-b0f3-be6c512e81f1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.412852 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af616c3a09547139caad766c911d055', 'request_id': 'req-252f42fc-ff54-428e-b0f3-be6c512e81f1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.427653 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] The token cache is being invalidate because project 1af616c3a09547139caad766c911d055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:35.427988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.428808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.430675 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1374/2752] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:35 2022] DELETE /identity/v3/projects/1af616c3a09547139caad766c911d055 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:35.435482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78559d0f-fa7d-41c3-9cc6-a9d382513d5e service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:35.446037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78559d0f-fa7d-41c3-9cc6-a9d382513d5e service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:35.516137 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:35.517268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:35.517683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:35.518121 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] PATH_INFO: `/v3/users/82d4c2a2855649eba65a7bf352e3433e` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:35.520142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d4c2a2855649eba65a7bf352e3433e)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:35.524079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:35.752903 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d4c2a2855649eba65a7bf352e3433e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.754087 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d4c2a2855649eba65a7bf352e3433e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.768107 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d4c2a2855649eba65a7bf352e3433e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.790032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d4c2a2855649eba65a7bf352e3433e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.793961 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-5850f734-1648-4953-b916-0741b01a83c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d4c2a2855649eba65a7bf352e3433e'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:35.795477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:35.909887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1379/2753] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:35 2022] DELETE /identity/v3/users/82d4c2a2855649eba65a7bf352e3433e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:36.378824 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:36.380768 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:36.398203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f42fc-ff54-428e-b0f3-be6c512e81f1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:36.476540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:36.477465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:36.477921 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:36.478379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] PATH_INFO: `/v3/projects/89580c87803a485081af31c19444667a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:36.479948 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=89580c87803a485081af31c19444667a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:36.481935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:36.605055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89580c87803a485081af31c19444667a', 'request_id': 'req-291c2e83-a973-4da4-9b21-fff1df08d0fa'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:36.666749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89580c87803a485081af31c19444667a', 'request_id': 'req-291c2e83-a973-4da4-9b21-fff1df08d0fa'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:36.672910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89580c87803a485081af31c19444667a', 'request_id': 'req-291c2e83-a973-4da4-9b21-fff1df08d0fa'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:36.680362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:36.685673 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] The token cache is being invalidate because project 89580c87803a485081af31c19444667a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:36.685966 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:36.686892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-291c2e83-a973-4da4-9b21-fff1df08d0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:36.689142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1375/2754] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:36 2022] DELETE /identity/v3/projects/89580c87803a485081af31c19444667a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:36.694199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baa0b-07c9-4628-a27c-cf3f6caed4eb None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:36.694704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baa0b-07c9-4628-a27c-cf3f6caed4eb None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:36.694805 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baa0b-07c9-4628-a27c-cf3f6caed4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:36.715088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-2c8baa0b-07c9-4628-a27c-cf3f6caed4eb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:36.716299 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-2c8baa0b-07c9-4628-a27c-cf3f6caed4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:36.777887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1380/2755] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:48:36.786752 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82722d-5b75-4cc4-85c9-9fa931d0cfa9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:36.787036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82722d-5b75-4cc4-85c9-9fa931d0cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:36.787307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82722d-5b75-4cc4-85c9-9fa931d0cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:36.808164 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fe82722d-5b75-4cc4-85c9-9fa931d0cfa9 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:36.809381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fe82722d-5b75-4cc4-85c9-9fa931d0cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:36.818145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1376/2756] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:36.822595 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8baa0b-07c9-4628-a27c-cf3f6caed4eb None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:36.832565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8baa0b-07c9-4628-a27c-cf3f6caed4eb None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:36.837112 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:36.837710 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:36.838006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:36.838285 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:36.838927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:48:36.839227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:36.840813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:36.853534 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1381/2757] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:48:36.858131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82722d-5b75-4cc4-85c9-9fa931d0cfa9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:36.868666 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82722d-5b75-4cc4-85c9-9fa931d0cfa9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:36.873654 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418faa-d77e-4fe1-a464-90fe23e18469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:36.874872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418faa-d77e-4fe1-a464-90fe23e18469 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:36.875434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418faa-d77e-4fe1-a464-90fe23e18469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:36.875434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9418faa-d77e-4fe1-a464-90fe23e18469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:36.875983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9418faa-d77e-4fe1-a464-90fe23e18469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:36.877874 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9418faa-d77e-4fe1-a464-90fe23e18469 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:36.974106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1377/2758] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:36 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:36.978281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:36.989242 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583c251-dd33-4cc8-aabe-dc9bb6f63a3b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:37.047652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542d6bd-f073-460b-8b60-0edc24b05626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:37.048293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542d6bd-f073-460b-8b60-0edc24b05626 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.048573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542d6bd-f073-460b-8b60-0edc24b05626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.048848 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542d6bd-f073-460b-8b60-0edc24b05626 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.049521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542d6bd-f073-460b-8b60-0edc24b05626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:37.051601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542d6bd-f073-460b-8b60-0edc24b05626 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:37.161437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1382/2759] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:36 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:37.165548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418faa-d77e-4fe1-a464-90fe23e18469 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:37.176790 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9418faa-d77e-4fe1-a464-90fe23e18469 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:37.181422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5c4f4-4c7a-41e2-bb4f-13d154d2a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:37.182051 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5c4f4-4c7a-41e2-bb4f-13d154d2a93d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.182628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5c4f4-4c7a-41e2-bb4f-13d154d2a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.182900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5c4f4-4c7a-41e2-bb4f-13d154d2a93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.183540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5c4f4-4c7a-41e2-bb4f-13d154d2a93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:37.185187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5c4f4-4c7a-41e2-bb4f-13d154d2a93d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:37.196163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1378/2760] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:37.200293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542d6bd-f073-460b-8b60-0edc24b05626 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:37.210495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542d6bd-f073-460b-8b60-0edc24b05626 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:37.215204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4c597-0ddb-4bb6-a050-ba23146557ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:37.215804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4c597-0ddb-4bb6-a050-ba23146557ce admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.216082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4c597-0ddb-4bb6-a050-ba23146557ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.216348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4c597-0ddb-4bb6-a050-ba23146557ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.216984 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4c597-0ddb-4bb6-a050-ba23146557ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:37.219575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4c597-0ddb-4bb6-a050-ba23146557ce admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:37.231857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1383/2761] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:37.237946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5c4f4-4c7a-41e2-bb4f-13d154d2a93d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:37.248736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5c4f4-4c7a-41e2-bb4f-13d154d2a93d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:37.253735 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afba961-153e-4703-90ac-20049a76afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:37.254434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afba961-153e-4703-90ac-20049a76afe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.254712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afba961-153e-4703-90ac-20049a76afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.254980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afba961-153e-4703-90ac-20049a76afe7 admin admin] PATH_INFO: `/v3/projects/5f0ce57f69484c2e8419b5e595de80c8/users/83ca528dce6d49ae85abf4eacba0155a/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.270136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afba961-153e-4703-90ac-20049a76afe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0ce57f69484c2e8419b5e595de80c8, user_id=83ca528dce6d49ae85abf4eacba0155a, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:37.272783 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afba961-153e-4703-90ac-20049a76afe7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:37.367219 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1379/2762] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:37 2022] PUT /identity/v3/projects/5f0ce57f69484c2e8419b5e595de80c8/users/83ca528dce6d49ae85abf4eacba0155a/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:37.378393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852a87-2cf8-4be5-a3aa-706081284611 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.378676 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852a87-2cf8-4be5-a3aa-706081284611 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.378949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852a87-2cf8-4be5-a3aa-706081284611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.409683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4c852a87-2cf8-4be5-a3aa-706081284611 None None] MFA Rules not processed for user `83ca528dce6d49ae85abf4eacba0155a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:37.410975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4c852a87-2cf8-4be5-a3aa-706081284611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:37.459504 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:37.477377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1384/2763] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:37.481959 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afba961-153e-4703-90ac-20049a76afe7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:37.552635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afba961-153e-4703-90ac-20049a76afe7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:37.557829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944361-998c-4a1f-999b-c931b2531c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:37.558494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944361-998c-4a1f-999b-c931b2531c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.558777 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944361-998c-4a1f-999b-c931b2531c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.559052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5944361-998c-4a1f-999b-c931b2531c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.559707 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944361-998c-4a1f-999b-c931b2531c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:37.562568 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5944361-998c-4a1f-999b-c931b2531c5b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:37.657444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1380/2764] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:37 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:37.661616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c852a87-2cf8-4be5-a3aa-706081284611 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:37.674006 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c852a87-2cf8-4be5-a3aa-706081284611 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:37.731129 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48230b3-39c5-4311-87c8-67fb66d3f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:37.731840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48230b3-39c5-4311-87c8-67fb66d3f96a admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.732054 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48230b3-39c5-4311-87c8-67fb66d3f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.732282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48230b3-39c5-4311-87c8-67fb66d3f96a admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.732938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48230b3-39c5-4311-87c8-67fb66d3f96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:37.735686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48230b3-39c5-4311-87c8-67fb66d3f96a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:37.810300 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1385/2765] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:37 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:37.814462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944361-998c-4a1f-999b-c931b2531c5b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:37.825032 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5944361-998c-4a1f-999b-c931b2531c5b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:37.829917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace3ee1-b365-4ceb-b980-ddef3c97d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:37.830692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3ee1-b365-4ceb-b980-ddef3c97d755 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.830977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3ee1-b365-4ceb-b980-ddef3c97d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.831252 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace3ee1-b365-4ceb-b980-ddef3c97d755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.831929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace3ee1-b365-4ceb-b980-ddef3c97d755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:37.833520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace3ee1-b365-4ceb-b980-ddef3c97d755 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:37.845443 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1381/2766] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:37.849820 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48230b3-39c5-4311-87c8-67fb66d3f96a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:37.861338 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48230b3-39c5-4311-87c8-67fb66d3f96a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:37.866309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b138-78b3-4781-9527-e29b21b96fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:37.866978 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b138-78b3-4781-9527-e29b21b96fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:37.867266 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b138-78b3-4781-9527-e29b21b96fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:37.867584 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2b138-78b3-4781-9527-e29b21b96fe1 admin admin] PATH_INFO: `/v3/projects/3c67eb5211e44047a56a3bdab6834328/users/90448e2a572649298844756d576829b3/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:37.886078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b138-78b3-4781-9527-e29b21b96fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c67eb5211e44047a56a3bdab6834328, user_id=90448e2a572649298844756d576829b3, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:37.888777 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2b138-78b3-4781-9527-e29b21b96fe1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:38.001406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1386/2767] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:37 2022] PUT /identity/v3/projects/3c67eb5211e44047a56a3bdab6834328/users/90448e2a572649298844756d576829b3/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:38.005392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace3ee1-b365-4ceb-b980-ddef3c97d755 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:38.017080 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace3ee1-b365-4ceb-b980-ddef3c97d755 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:38.078802 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447adbd8-c31a-4117-bbdd-21612ef3c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:38.079411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447adbd8-c31a-4117-bbdd-21612ef3c580 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:38.079692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447adbd8-c31a-4117-bbdd-21612ef3c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:38.079988 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447adbd8-c31a-4117-bbdd-21612ef3c580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:38.080629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447adbd8-c31a-4117-bbdd-21612ef3c580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:38.082259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447adbd8-c31a-4117-bbdd-21612ef3c580 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:38.093370 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1382/2768] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:38.097609 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b138-78b3-4781-9527-e29b21b96fe1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:38.108744 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2b138-78b3-4781-9527-e29b21b96fe1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:38.113345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:38.114064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:38.114310 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:38.114580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] PATH_INFO: `/v3/projects/3c67eb5211e44047a56a3bdab6834328/users/90448e2a572649298844756d576829b3/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:38.116483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c67eb5211e44047a56a3bdab6834328, user_id=90448e2a572649298844756d576829b3, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:38.119147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:38.130061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1387/2769] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:38 2022] PUT /identity/v3/projects/3c67eb5211e44047a56a3bdab6834328/users/90448e2a572649298844756d576829b3/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:38.198351 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9edf5-5c2b-46e6-bf1c-0be09c0c3be7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:38.198661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9edf5-5c2b-46e6-bf1c-0be09c0c3be7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:38.198941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9edf5-5c2b-46e6-bf1c-0be09c0c3be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:38.207974 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:38.231082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-aca9edf5-5c2b-46e6-bf1c-0be09c0c3be7 None None] MFA Rules not processed for user `90448e2a572649298844756d576829b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:38.232342 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-aca9edf5-5c2b-46e6-bf1c-0be09c0c3be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:38.321042 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1383/2770] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:38.333316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:38.335061 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:38.398024 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e396419-9fe2-4d19-aea9-7db065b77721 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:38.401583 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359abe8c-ce9c-445d-8e7a-869eb8f26ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:38.402253 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abe8c-ce9c-445d-8e7a-869eb8f26ead service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:38.402511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abe8c-ce9c-445d-8e7a-869eb8f26ead service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:38.402784 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abe8c-ce9c-445d-8e7a-869eb8f26ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:38.413109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359abe8c-ce9c-445d-8e7a-869eb8f26ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:38.414605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359abe8c-ce9c-445d-8e7a-869eb8f26ead service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:38.425847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1388/2771] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:48:38.562980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9edf5-5c2b-46e6-bf1c-0be09c0c3be7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:38.576271 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9edf5-5c2b-46e6-bf1c-0be09c0c3be7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:38.577269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7f2fa-9bad-4979-a593-cd3e3595529c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:38.577885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7f2fa-9bad-4979-a593-cd3e3595529c service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:38.578208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7f2fa-9bad-4979-a593-cd3e3595529c service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:38.578481 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7f2fa-9bad-4979-a593-cd3e3595529c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:38.640228 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7f2fa-9bad-4979-a593-cd3e3595529c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:38.641804 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7f2fa-9bad-4979-a593-cd3e3595529c service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:38.651958 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1384/2772] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:41.847704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359abe8c-ce9c-445d-8e7a-869eb8f26ead service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:41.896642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:41.914122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359abe8c-ce9c-445d-8e7a-869eb8f26ead service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:41.918658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:41.919286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:41.919565 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:41.919831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] PATH_INFO: `/v3/users/83ca528dce6d49ae85abf4eacba0155a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:41.921018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ca528dce6d49ae85abf4eacba0155a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:41.923053 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:42.172133 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ca528dce6d49ae85abf4eacba0155a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:42.172728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ca528dce6d49ae85abf4eacba0155a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:42.180601 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ca528dce6d49ae85abf4eacba0155a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:42.195774 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ca528dce6d49ae85abf4eacba0155a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:42.196577 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ca528dce6d49ae85abf4eacba0155a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:42.286055 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1389/2773] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:41 2022] DELETE /identity/v3/users/83ca528dce6d49ae85abf4eacba0155a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:42.291178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca427b4c-127e-45b4-be5a-f5f1866fabbb None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:42.292102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca427b4c-127e-45b4-be5a-f5f1866fabbb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:42.292102 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca427b4c-127e-45b4-be5a-f5f1866fabbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:42.317527 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ca427b4c-127e-45b4-be5a-f5f1866fabbb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:42.318814 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ca427b4c-127e-45b4-be5a-f5f1866fabbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:42.384380 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1385/2774] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:42.395529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:42.396979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:42.459585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67ae9f-310f-47bd-bed8-4f825fd90f8c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:42.463433 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc88fc-40d1-4236-95ef-1741b3f32905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:42.464037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc88fc-40d1-4236-95ef-1741b3f32905 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:42.464316 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc88fc-40d1-4236-95ef-1741b3f32905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:42.464589 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc88fc-40d1-4236-95ef-1741b3f32905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:42.475686 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc88fc-40d1-4236-95ef-1741b3f32905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:42.477162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc88fc-40d1-4236-95ef-1741b3f32905 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:42.487155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1390/2775] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:42.977704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca427b4c-127e-45b4-be5a-f5f1866fabbb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:42.979385 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ca427b4c-127e-45b4-be5a-f5f1866fabbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:42.995177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca427b4c-127e-45b4-be5a-f5f1866fabbb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:43.002005 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:43.002750 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:43.003030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:43.003333 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] PATH_INFO: `/v3/projects/5f0ce57f69484c2e8419b5e595de80c8` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:43.004599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0ce57f69484c2e8419b5e595de80c8)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:43.006511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:43.034783 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:43.185531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0ce57f69484c2e8419b5e595de80c8', 'request_id': 'req-4cbdf5b3-9c27-4f0c-a761-80287157a41b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.269123 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0ce57f69484c2e8419b5e595de80c8', 'request_id': 'req-4cbdf5b3-9c27-4f0c-a761-80287157a41b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.275520 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0ce57f69484c2e8419b5e595de80c8', 'request_id': 'req-4cbdf5b3-9c27-4f0c-a761-80287157a41b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.288997 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] The token cache is being invalidate because project 5f0ce57f69484c2e8419b5e595de80c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:43.289286 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.289951 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.291513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1386/2776] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:42 2022] DELETE /identity/v3/projects/5f0ce57f69484c2e8419b5e595de80c8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:43.295938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc88fc-40d1-4236-95ef-1741b3f32905 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:43.306831 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc88fc-40d1-4236-95ef-1741b3f32905 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:43.374936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:43.375585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:43.375868 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:43.376145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] PATH_INFO: `/v3/users/90448e2a572649298844756d576829b3` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:43.377363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90448e2a572649298844756d576829b3)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:43.379336 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:43.385330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:43.549763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90448e2a572649298844756d576829b3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.550484 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90448e2a572649298844756d576829b3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.559840 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90448e2a572649298844756d576829b3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.574663 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90448e2a572649298844756d576829b3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.575586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-b225c28b-6352-4867-aff1-67a5bd547cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90448e2a572649298844756d576829b3'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:43.673124 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1391/2777] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:43 2022] DELETE /identity/v3/users/90448e2a572649298844756d576829b3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:44.188178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:44.190261 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:44.208835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdf5b3-9c27-4f0c-a761-80287157a41b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:44.289352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:44.290056 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:44.290299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:44.290571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] PATH_INFO: `/v3/projects/3c67eb5211e44047a56a3bdab6834328` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:44.291711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c67eb5211e44047a56a3bdab6834328)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:44.293584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:44.400831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c67eb5211e44047a56a3bdab6834328', 'request_id': 'req-690ab429-2899-455c-9c59-2bc8dd6a2ca3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:44.463649 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c67eb5211e44047a56a3bdab6834328', 'request_id': 'req-690ab429-2899-455c-9c59-2bc8dd6a2ca3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:44.470538 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c67eb5211e44047a56a3bdab6834328', 'request_id': 'req-690ab429-2899-455c-9c59-2bc8dd6a2ca3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:44.482971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] The token cache is being invalidate because project 3c67eb5211e44047a56a3bdab6834328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:44.483264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:44.484285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-690ab429-2899-455c-9c59-2bc8dd6a2ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:44.486176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1387/2778] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:44 2022] DELETE /identity/v3/projects/3c67eb5211e44047a56a3bdab6834328 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:44.490801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67a66-2b09-45e9-8edb-7b501f24ce64 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:44.491367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67a66-2b09-45e9-8edb-7b501f24ce64 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:44.491367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e67a66-2b09-45e9-8edb-7b501f24ce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:44.514042 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d0e67a66-2b09-45e9-8edb-7b501f24ce64 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:44.515972 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d0e67a66-2b09-45e9-8edb-7b501f24ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:44.581202 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1392/2779] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:44.589501 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e4dd-2ade-4aec-a78e-e455aee9cc45 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:44.589920 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e4dd-2ade-4aec-a78e-e455aee9cc45 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:44.590321 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9e4dd-2ade-4aec-a78e-e455aee9cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:44.611574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0ac9e4dd-2ade-4aec-a78e-e455aee9cc45 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:44.612913 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0ac9e4dd-2ade-4aec-a78e-e455aee9cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:44.621178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1388/2780] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:44.627492 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e67a66-2b09-45e9-8edb-7b501f24ce64 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:44.645482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e67a66-2b09-45e9-8edb-7b501f24ce64 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:44.653139 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:44.654150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:44.654588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:44.655329 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:44.657322 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:48:44.657806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:44.660891 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:44.681037 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1393/2781] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:48:44.686114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9e4dd-2ade-4aec-a78e-e455aee9cc45 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:44.696255 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9e4dd-2ade-4aec-a78e-e455aee9cc45 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:44.701434 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e07e7-58c6-4f43-a8ca-d8667bf1178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:44.702208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e07e7-58c6-4f43-a8ca-d8667bf1178f admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:44.703179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e07e7-58c6-4f43-a8ca-d8667bf1178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:44.703678 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e07e7-58c6-4f43-a8ca-d8667bf1178f admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:44.704455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e07e7-58c6-4f43-a8ca-d8667bf1178f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:44.706648 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e07e7-58c6-4f43-a8ca-d8667bf1178f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:44.818451 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1389/2782] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:44 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:44.823172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:44.833946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81ba9c-6c84-45f8-9002-2387c2c42cc2 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:44.897621 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2870-174d-4b06-b768-82801faaa472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:44.898379 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2870-174d-4b06-b768-82801faaa472 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:44.898701 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2870-174d-4b06-b768-82801faaa472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:44.899010 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2870-174d-4b06-b768-82801faaa472 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:44.899712 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2870-174d-4b06-b768-82801faaa472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:44.901711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2870-174d-4b06-b768-82801faaa472 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:44.998956 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1394/2783] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:44 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:48:45.003977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e07e7-58c6-4f43-a8ca-d8667bf1178f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:45.015157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e07e7-58c6-4f43-a8ca-d8667bf1178f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:45.020312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0d28-a606-4880-a738-585edd9f4329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:45.021003 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0d28-a606-4880-a738-585edd9f4329 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.021320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0d28-a606-4880-a738-585edd9f4329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.021630 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0d28-a606-4880-a738-585edd9f4329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.022379 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb0d28-a606-4880-a738-585edd9f4329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:45.024082 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb0d28-a606-4880-a738-585edd9f4329 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:45.035267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1390/2784] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:45.039876 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2870-174d-4b06-b768-82801faaa472 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:45.045591 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:45.052302 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2870-174d-4b06-b768-82801faaa472 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:45.057698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5a008-283b-4309-9d37-89af21dbf147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:45.058538 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a008-283b-4309-9d37-89af21dbf147 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.058941 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a008-283b-4309-9d37-89af21dbf147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.059269 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a008-283b-4309-9d37-89af21dbf147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.060113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5a008-283b-4309-9d37-89af21dbf147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:45.062496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5a008-283b-4309-9d37-89af21dbf147 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:45.074073 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1395/2785] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:48:45.079158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0d28-a606-4880-a738-585edd9f4329 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:45.084858 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:45.090795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0d28-a606-4880-a738-585edd9f4329 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:45.095977 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03676405-5e04-448d-b0e9-84d08065b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:45.096736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03676405-5e04-448d-b0e9-84d08065b181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.097108 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03676405-5e04-448d-b0e9-84d08065b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.097499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03676405-5e04-448d-b0e9-84d08065b181 admin admin] PATH_INFO: `/v3/projects/28554d9c4f324736ba2d76c342eff134/users/f31ddae40c1549c58c81af73e9c71e48/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.115004 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03676405-5e04-448d-b0e9-84d08065b181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28554d9c4f324736ba2d76c342eff134, user_id=f31ddae40c1549c58c81af73e9c71e48, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:45.117677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03676405-5e04-448d-b0e9-84d08065b181 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:45.232609 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1391/2786] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:45 2022] PUT /identity/v3/projects/28554d9c4f324736ba2d76c342eff134/users/f31ddae40c1549c58c81af73e9c71e48/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:45.245861 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a25c4-bd6e-4232-8ae9-6b366024864d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.246222 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a25c4-bd6e-4232-8ae9-6b366024864d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.246623 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a25c4-bd6e-4232-8ae9-6b366024864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.278893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-090a25c4-bd6e-4232-8ae9-6b366024864d None None] MFA Rules not processed for user `f31ddae40c1549c58c81af73e9c71e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:45.280142 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-090a25c4-bd6e-4232-8ae9-6b366024864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:45.351845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1396/2787] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:45.357369 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03676405-5e04-448d-b0e9-84d08065b181 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:45.434711 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03676405-5e04-448d-b0e9-84d08065b181 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:45.440361 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40a71b-37c4-4e5c-8423-abc1a3d0b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:45.441008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40a71b-37c4-4e5c-8423-abc1a3d0b90a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.441329 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40a71b-37c4-4e5c-8423-abc1a3d0b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.441706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40a71b-37c4-4e5c-8423-abc1a3d0b90a admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.442509 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40a71b-37c4-4e5c-8423-abc1a3d0b90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:45.444453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40a71b-37c4-4e5c-8423-abc1a3d0b90a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:45.525720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1392/2788] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:45 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:45.530705 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a25c4-bd6e-4232-8ae9-6b366024864d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:45.542218 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a25c4-bd6e-4232-8ae9-6b366024864d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:45.604707 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc15f-8ea3-4845-953a-69730307a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:45.605301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc15f-8ea3-4845-953a-69730307a238 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.605622 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc15f-8ea3-4845-953a-69730307a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.605940 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bc15f-8ea3-4845-953a-69730307a238 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.606692 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bc15f-8ea3-4845-953a-69730307a238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:45.609227 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bc15f-8ea3-4845-953a-69730307a238 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:45.705109 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1397/2789] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:45 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:45.709556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40a71b-37c4-4e5c-8423-abc1a3d0b90a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:45.721406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40a71b-37c4-4e5c-8423-abc1a3d0b90a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:45.727191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af96acc-e480-422a-8546-2a74c92edefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:45.727815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af96acc-e480-422a-8546-2a74c92edefc admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.728092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af96acc-e480-422a-8546-2a74c92edefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.728368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af96acc-e480-422a-8546-2a74c92edefc admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.729027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af96acc-e480-422a-8546-2a74c92edefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:45.730661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af96acc-e480-422a-8546-2a74c92edefc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:45.750030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1393/2790] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:45.754620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc15f-8ea3-4845-953a-69730307a238 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:45.766689 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bc15f-8ea3-4845-953a-69730307a238 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:45.771652 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f5ae8-7650-45be-8fd2-85b079b189ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:45.772363 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f5ae8-7650-45be-8fd2-85b079b189ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.772688 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f5ae8-7650-45be-8fd2-85b079b189ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.772999 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f5ae8-7650-45be-8fd2-85b079b189ae admin admin] PATH_INFO: `/v3/projects/1bd47efc1ae646da954a1c68eed47b70/users/09fbdf7a4a45453ca1907b3ea7fbaece/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.790086 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f5ae8-7650-45be-8fd2-85b079b189ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd47efc1ae646da954a1c68eed47b70, user_id=09fbdf7a4a45453ca1907b3ea7fbaece, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:45.792801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f5ae8-7650-45be-8fd2-85b079b189ae admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:45.870182 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1398/2791] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:45 2022] PUT /identity/v3/projects/1bd47efc1ae646da954a1c68eed47b70/users/09fbdf7a4a45453ca1907b3ea7fbaece/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:45.875236 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af96acc-e480-422a-8546-2a74c92edefc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:45.886551 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af96acc-e480-422a-8546-2a74c92edefc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:45.983087 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc3e92-cd69-4b34-bd8e-39fce7b045dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:45.984378 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3e92-cd69-4b34-bd8e-39fce7b045dc admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:45.984704 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3e92-cd69-4b34-bd8e-39fce7b045dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:45.985257 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc3e92-cd69-4b34-bd8e-39fce7b045dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:45.986070 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc3e92-cd69-4b34-bd8e-39fce7b045dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:45.987837 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc3e92-cd69-4b34-bd8e-39fce7b045dc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:45.999268 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1394/2792] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:46.003886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f5ae8-7650-45be-8fd2-85b079b189ae admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:46.014983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f5ae8-7650-45be-8fd2-85b079b189ae admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:46.020027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:46.020841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:46.022044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:46.022044 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] PATH_INFO: `/v3/projects/1bd47efc1ae646da954a1c68eed47b70/users/09fbdf7a4a45453ca1907b3ea7fbaece/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:46.024332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd47efc1ae646da954a1c68eed47b70, user_id=09fbdf7a4a45453ca1907b3ea7fbaece, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:46.027332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:46.038939 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1399/2793] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:46 2022] PUT /identity/v3/projects/1bd47efc1ae646da954a1c68eed47b70/users/09fbdf7a4a45453ca1907b3ea7fbaece/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:46.052304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158f08-7452-4c05-b3a6-336e2545f615 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:46.052736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158f08-7452-4c05-b3a6-336e2545f615 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:46.053113 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158f08-7452-4c05-b3a6-336e2545f615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:46.084795 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d0158f08-7452-4c05-b3a6-336e2545f615 None None] MFA Rules not processed for user `09fbdf7a4a45453ca1907b3ea7fbaece`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:46.086316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d0158f08-7452-4c05-b3a6-336e2545f615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:46.131761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:46.170463 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1395/2794] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:46.183507 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:46.185673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:46.235801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:46.266813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f09e-a597-4356-8a6e-452e7d981d02 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:46.271787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87547012-5f96-42ef-ae36-af74e8a4d860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:46.272859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87547012-5f96-42ef-ae36-af74e8a4d860 service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:46.273147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87547012-5f96-42ef-ae36-af74e8a4d860 service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:46.273428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87547012-5f96-42ef-ae36-af74e8a4d860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:46.286911 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87547012-5f96-42ef-ae36-af74e8a4d860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:46.288557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87547012-5f96-42ef-ae36-af74e8a4d860 service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:46.301809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1400/2795] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:46.471769 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0158f08-7452-4c05-b3a6-336e2545f615 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:46.489940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0158f08-7452-4c05-b3a6-336e2545f615 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:46.496173 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108ab36-2d3d-4dd2-b818-5ec82b163e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:46.510626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ab36-2d3d-4dd2-b818-5ec82b163e7f service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:46.510626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ab36-2d3d-4dd2-b818-5ec82b163e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:46.510626 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ab36-2d3d-4dd2-b818-5ec82b163e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:46.569608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108ab36-2d3d-4dd2-b818-5ec82b163e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:46.571287 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108ab36-2d3d-4dd2-b818-5ec82b163e7f service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:46.582901 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1396/2796] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:47.175319 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87547012-5f96-42ef-ae36-af74e8a4d860 service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:47.258376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87547012-5f96-42ef-ae36-af74e8a4d860 service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:47.263421 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:47.264068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:47.264348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:47.264724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] PATH_INFO: `/v3/users/f31ddae40c1549c58c81af73e9c71e48` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:47.266148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31ddae40c1549c58c81af73e9c71e48)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:47.268089 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:47.457356 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31ddae40c1549c58c81af73e9c71e48'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:47.458158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31ddae40c1549c58c81af73e9c71e48'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:47.466483 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31ddae40c1549c58c81af73e9c71e48'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:47.482495 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31ddae40c1549c58c81af73e9c71e48'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:47.483283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31ddae40c1549c58c81af73e9c71e48'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:47.553043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1401/2797] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:47 2022] DELETE /identity/v3/users/f31ddae40c1549c58c81af73e9c71e48 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:47.558035 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d9294-644c-46ed-8b89-c58380dc58bf None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:47.561141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d9294-644c-46ed-8b89-c58380dc58bf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:47.561141 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d9294-644c-46ed-8b89-c58380dc58bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:47.580854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e15d9294-644c-46ed-8b89-c58380dc58bf None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:47.582176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e15d9294-644c-46ed-8b89-c58380dc58bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:47.657599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1397/2798] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:47.669332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:47.670857 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:47.736757 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0e695-3690-401a-8ec3-dc4b794ccd5e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:47.740765 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec554d48-b093-43f5-941d-67c2cf8f8e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:47.741396 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec554d48-b093-43f5-941d-67c2cf8f8e69 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:47.741677 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec554d48-b093-43f5-941d-67c2cf8f8e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:47.741951 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec554d48-b093-43f5-941d-67c2cf8f8e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:47.752799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec554d48-b093-43f5-941d-67c2cf8f8e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:47.754307 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec554d48-b093-43f5-941d-67c2cf8f8e69 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:47.758879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:47.767095 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1402/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:48.266176 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d9294-644c-46ed-8b89-c58380dc58bf None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:48.268089 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e15d9294-644c-46ed-8b89-c58380dc58bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:48.280529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d9294-644c-46ed-8b89-c58380dc58bf None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:48.285459 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:48.286132 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:48.286408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:48.286672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] PATH_INFO: `/v3/projects/28554d9c4f324736ba2d76c342eff134` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:48.288045 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28554d9c4f324736ba2d76c342eff134)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:48.290060 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:48.450395 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28554d9c4f324736ba2d76c342eff134', 'request_id': 'req-cf0f3ef6-784c-4003-ad1e-b9150f351c08'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.523929 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28554d9c4f324736ba2d76c342eff134', 'request_id': 'req-cf0f3ef6-784c-4003-ad1e-b9150f351c08'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.531636 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28554d9c4f324736ba2d76c342eff134', 'request_id': 'req-cf0f3ef6-784c-4003-ad1e-b9150f351c08'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.535008 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:48.547736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] The token cache is being invalidate because project 28554d9c4f324736ba2d76c342eff134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:48.548068 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.548720 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.550391 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1398/2800] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:48 2022] DELETE /identity/v3/projects/28554d9c4f324736ba2d76c342eff134 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:48.554866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec554d48-b093-43f5-941d-67c2cf8f8e69 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:48.566987 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec554d48-b093-43f5-941d-67c2cf8f8e69 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:48.636967 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:48.637611 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:48.637887 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:48.638192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] PATH_INFO: `/v3/users/09fbdf7a4a45453ca1907b3ea7fbaece` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:48.639416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fbdf7a4a45453ca1907b3ea7fbaece)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:48.641378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:48.843750 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fbdf7a4a45453ca1907b3ea7fbaece'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.844427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fbdf7a4a45453ca1907b3ea7fbaece'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.853043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fbdf7a4a45453ca1907b3ea7fbaece'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.867606 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fbdf7a4a45453ca1907b3ea7fbaece'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.868330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-1a3be24f-87d2-44fd-8e35-5f136c8222eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fbdf7a4a45453ca1907b3ea7fbaece'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:48.993181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1403/2801] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:48 2022] DELETE /identity/v3/users/09fbdf7a4a45453ca1907b3ea7fbaece => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:49.466953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:49.468558 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:49.488833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f3ef6-784c-4003-ad1e-b9150f351c08 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:49.565430 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:49.566306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:49.566681 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:49.567055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] PATH_INFO: `/v3/projects/1bd47efc1ae646da954a1c68eed47b70` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:49.568529 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd47efc1ae646da954a1c68eed47b70)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:49.570776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:49.718169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd47efc1ae646da954a1c68eed47b70', 'request_id': 'req-e1982897-0d03-4932-8ee6-bb2a0755cba0'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:49.792429 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd47efc1ae646da954a1c68eed47b70', 'request_id': 'req-e1982897-0d03-4932-8ee6-bb2a0755cba0'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:49.799996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd47efc1ae646da954a1c68eed47b70', 'request_id': 'req-e1982897-0d03-4932-8ee6-bb2a0755cba0'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:49.814878 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] The token cache is being invalidate because project 1bd47efc1ae646da954a1c68eed47b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:49.815239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:49.815993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e1982897-0d03-4932-8ee6-bb2a0755cba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:49.817669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1399/2802] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:49 2022] DELETE /identity/v3/projects/1bd47efc1ae646da954a1c68eed47b70 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:49.823864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd84ff-77ff-423b-855e-cdc7830dac93 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:49.824444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd84ff-77ff-423b-855e-cdc7830dac93 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:49.824642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd84ff-77ff-423b-855e-cdc7830dac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:49.849414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-82fd84ff-77ff-423b-855e-cdc7830dac93 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:49.850816 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-82fd84ff-77ff-423b-855e-cdc7830dac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:49.935517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1404/2803] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:48:49.944909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc711b42-8e5f-4b3a-bc95-37e510398af3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:49.945368 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc711b42-8e5f-4b3a-bc95-37e510398af3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:49.945727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc711b42-8e5f-4b3a-bc95-37e510398af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:49.969610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fc711b42-8e5f-4b3a-bc95-37e510398af3 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:49.970870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fc711b42-8e5f-4b3a-bc95-37e510398af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:49.979499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1400/2804] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:48:49.984721 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd84ff-77ff-423b-855e-cdc7830dac93 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:49.995469 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd84ff-77ff-423b-855e-cdc7830dac93 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:50.001151 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:50.001790 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.002105 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.002376 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.003050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:48:50.003355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:50.005008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:50.020145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1405/2805] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 22 14:48:50.026692 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc711b42-8e5f-4b3a-bc95-37e510398af3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:50.036884 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc711b42-8e5f-4b3a-bc95-37e510398af3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:50.041954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976bf4f-6aa1-40bd-8c4c-759df6a27d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:50.042628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976bf4f-6aa1-40bd-8c4c-759df6a27d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.042909 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976bf4f-6aa1-40bd-8c4c-759df6a27d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.043181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976bf4f-6aa1-40bd-8c4c-759df6a27d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.043866 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976bf4f-6aa1-40bd-8c4c-759df6a27d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:50.046446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976bf4f-6aa1-40bd-8c4c-759df6a27d12 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:50.177706 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1401/2806] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:48:50 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:48:50.182581 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:50.190162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:50.196480 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f1e21-c6b6-4ea3-a1bc-440c62328f70 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:50.261071 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552dbff-8e61-4676-a785-3b1a1513ebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:50.261704 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552dbff-8e61-4676-a785-3b1a1513ebfc admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.262035 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552dbff-8e61-4676-a785-3b1a1513ebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.262284 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552dbff-8e61-4676-a785-3b1a1513ebfc admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.262938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552dbff-8e61-4676-a785-3b1a1513ebfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:50.265197 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552dbff-8e61-4676-a785-3b1a1513ebfc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:50.372471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1406/2807] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:48:50 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:48:50.377810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976bf4f-6aa1-40bd-8c4c-759df6a27d12 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:50.392180 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976bf4f-6aa1-40bd-8c4c-759df6a27d12 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:50.400140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702a367-c7ae-4ea6-a4c8-b03ceabc3d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:50.401183 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702a367-c7ae-4ea6-a4c8-b03ceabc3d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.401661 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702a367-c7ae-4ea6-a4c8-b03ceabc3d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.402163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702a367-c7ae-4ea6-a4c8-b03ceabc3d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.404460 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702a367-c7ae-4ea6-a4c8-b03ceabc3d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:50.406927 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702a367-c7ae-4ea6-a4c8-b03ceabc3d27 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:50.426681 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1402/2808] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:48:50.430955 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552dbff-8e61-4676-a785-3b1a1513ebfc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:50.442562 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552dbff-8e61-4676-a785-3b1a1513ebfc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:50.447626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98ca45-c19c-45af-b9d7-a67cb4dd2c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:50.448161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98ca45-c19c-45af-b9d7-a67cb4dd2c87 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.448440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98ca45-c19c-45af-b9d7-a67cb4dd2c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.448763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98ca45-c19c-45af-b9d7-a67cb4dd2c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.449420 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98ca45-c19c-45af-b9d7-a67cb4dd2c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:50.451123 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98ca45-c19c-45af-b9d7-a67cb4dd2c87 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:50.468450 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1407/2809] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:48:50.473272 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702a367-c7ae-4ea6-a4c8-b03ceabc3d27 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:50.485055 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702a367-c7ae-4ea6-a4c8-b03ceabc3d27 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:50.490174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:50.490861 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.491137 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.491408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] PATH_INFO: `/v3/projects/ecf2dfae27f441e0b0616813cd78e898/users/e37f2ab0857d4e1d8d214fbfc9511019/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.511682 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf2dfae27f441e0b0616813cd78e898, user_id=e37f2ab0857d4e1d8d214fbfc9511019, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:50.517815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:50.615810 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1403/2810] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:48:50 2022] PUT /identity/v3/projects/ecf2dfae27f441e0b0616813cd78e898/users/e37f2ab0857d4e1d8d214fbfc9511019/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:48:50.627532 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001868-369a-4756-b1df-e0b687e7e1d9 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.627821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001868-369a-4756-b1df-e0b687e7e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.628066 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99001868-369a-4756-b1df-e0b687e7e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.667206 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-99001868-369a-4756-b1df-e0b687e7e1d9 None None] MFA Rules not processed for user `e37f2ab0857d4e1d8d214fbfc9511019`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:50.671008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-99001868-369a-4756-b1df-e0b687e7e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:50.755675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1408/2811] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:48:50.768594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:50.770446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:50.801466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:50.845687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0d874-8200-41db-a280-e01fce2ff3b9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:50.849966 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbf414-3c7f-4dc2-9e1f-b8bc9f2c60c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:50.850742 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf414-3c7f-4dc2-9e1f-b8bc9f2c60c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.851023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf414-3c7f-4dc2-9e1f-b8bc9f2c60c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.851404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbf414-3c7f-4dc2-9e1f-b8bc9f2c60c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.861599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbf414-3c7f-4dc2-9e1f-b8bc9f2c60c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:50.863437 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbf414-3c7f-4dc2-9e1f-b8bc9f2c60c1 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:50.874643 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1404/2812] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:50.905904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99001868-369a-4756-b1df-e0b687e7e1d9 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:50.990126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99001868-369a-4756-b1df-e0b687e7e1d9 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:50.995651 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:50.996547 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:50.996927 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:50.997311 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] PATH_INFO: `/v3/users/e37f2ab0857d4e1d8d214fbfc9511019` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:50.998853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37f2ab0857d4e1d8d214fbfc9511019)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:51.001905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:51.019385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:48:51.248236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37f2ab0857d4e1d8d214fbfc9511019'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:51.251580 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37f2ab0857d4e1d8d214fbfc9511019'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:51.268172 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37f2ab0857d4e1d8d214fbfc9511019'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:51.294590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37f2ab0857d4e1d8d214fbfc9511019'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:51.295447 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37f2ab0857d4e1d8d214fbfc9511019'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:51.430554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1409/2813] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:48:50 2022] DELETE /identity/v3/users/e37f2ab0857d4e1d8d214fbfc9511019 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:48:51.436265 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc6a3-1a67-43bd-b3b1-a1d5941e979d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:51.438985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc6a3-1a67-43bd-b3b1-a1d5941e979d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:51.438985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc6a3-1a67-43bd-b3b1-a1d5941e979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:51.460523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7effc6a3-1a67-43bd-b3b1-a1d5941e979d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:48:51.461859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7effc6a3-1a67-43bd-b3b1-a1d5941e979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:51.538622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1405/2814] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:48:51.552344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:51.553836 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:51.623869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704d31f-6c16-4ff0-a5f9-af46b5b83a93 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:51.629177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e94d1-b8b8-4f88-be01-63868cd28993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:51.629971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e94d1-b8b8-4f88-be01-63868cd28993 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:51.630398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e94d1-b8b8-4f88-be01-63868cd28993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:51.630728 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e94d1-b8b8-4f88-be01-63868cd28993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:51.644799 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e94d1-b8b8-4f88-be01-63868cd28993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:51.647841 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e94d1-b8b8-4f88-be01-63868cd28993 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:51.665793 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1410/2815] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:48:52.215633 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effc6a3-1a67-43bd-b3b1-a1d5941e979d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:48:52.217416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7effc6a3-1a67-43bd-b3b1-a1d5941e979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:48:52.244402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effc6a3-1a67-43bd-b3b1-a1d5941e979d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:48:52.258862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:48:52.258862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:48:52.258862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:48:52.258862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] PATH_INFO: `/v3/projects/ecf2dfae27f441e0b0616813cd78e898` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:48:52.259683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf2dfae27f441e0b0616813cd78e898)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:48:52.263407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:48:52.388691 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf2dfae27f441e0b0616813cd78e898', 'request_id': 'req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:52.477885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf2dfae27f441e0b0616813cd78e898', 'request_id': 'req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:52.485364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf2dfae27f441e0b0616813cd78e898', 'request_id': 'req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:52.499639 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] The token cache is being invalidate because project ecf2dfae27f441e0b0616813cd78e898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:48:52.500014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:52.500830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:48:52.502584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1406/2816] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:48:52 2022] DELETE /identity/v3/projects/ecf2dfae27f441e0b0616813cd78e898 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:49:01.659011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=47,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:49:02.495652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:49:18.490954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff18bf5-3b28-4753-8346-57130c830bae None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:49:18.497553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff18bf5-3b28-4753-8346-57130c830bae None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:49:18.497553 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff18bf5-3b28-4753-8346-57130c830bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:49:18.515440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-9ff18bf5-3b28-4753-8346-57130c830bae None None] MFA Rules not processed for user `076dc430ffdf44aba8eb012f53434a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:49:18.516792 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9ff18bf5-3b28-4753-8346-57130c830bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:49:18.577656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1411/2817] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:49:28.571225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=25 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:17.575903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:17.577549 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:17.655276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff898e-6a2d-414f-b9fe-bbf0e8c24d1b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:17.660616 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:17.661308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:17.661585 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:17.661891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:17.664027 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:17.771586 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:17.772531 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:17.812851 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1407/2818] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:50:21.097815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff18bf5-3b28-4753-8346-57130c830bae None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:21.102246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9ff18bf5-3b28-4753-8346-57130c830bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:21.113079 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff18bf5-3b28-4753-8346-57130c830bae None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:21.117029 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:21.117655 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:21.117936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:21.118251 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:21.120230 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:21.143286 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:21.146088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:21.163950 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1412/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:50:27.806622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=66 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:31.158082 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=6 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:33.175062 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:33.177422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:33.256684 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583d31-839e-4e2b-ae73-bfd2c372c4f1 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:33.260416 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:33.261225 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:33.268174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:33.268174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:33.268174 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:33.337238 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:33.338748 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:33.350594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1408/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:50:37.790724 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:37.792871 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:37.809477 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b193d8-2bbe-4402-92f5-1fe6fa95a9bd service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:37.814524 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:37.815160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:37.815432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:37.815698 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] PATH_INFO: `/v3/users/076dc430ffdf44aba8eb012f53434a01` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:37.816825 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=076dc430ffdf44aba8eb012f53434a01)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:37.818759 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:38.050862 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076dc430ffdf44aba8eb012f53434a01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.051555 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076dc430ffdf44aba8eb012f53434a01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.060949 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076dc430ffdf44aba8eb012f53434a01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.075543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076dc430ffdf44aba8eb012f53434a01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.076436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-2ce2a3be-d3c1-4f3a-a5e4-0bf2492d13fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076dc430ffdf44aba8eb012f53434a01'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.162976 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1413/2821] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:50:37 2022] DELETE /identity/v3/users/076dc430ffdf44aba8eb012f53434a01 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:38.482803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:38.498276 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55311dc6-36eb-47a4-a4b5-f6d111f5bedb service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:38.581203 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:38.581869 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:38.582260 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:38.582606 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] PATH_INFO: `/v3/projects/3aae8105b1e440e7873e5ee2dfa14c93` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:38.583928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aae8105b1e440e7873e5ee2dfa14c93)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:38.586104 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:38.683992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aae8105b1e440e7873e5ee2dfa14c93', 'request_id': 'req-fef807ca-eee1-40b0-bfa9-8bdd019d0017'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.687651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:38.753944 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aae8105b1e440e7873e5ee2dfa14c93', 'request_id': 'req-fef807ca-eee1-40b0-bfa9-8bdd019d0017'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.761822 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aae8105b1e440e7873e5ee2dfa14c93', 'request_id': 'req-fef807ca-eee1-40b0-bfa9-8bdd019d0017'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.774849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] The token cache is being invalidate because project 3aae8105b1e440e7873e5ee2dfa14c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:50:38.775172 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.775800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fef807ca-eee1-40b0-bfa9-8bdd019d0017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:38.777450 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1409/2822] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:50:38 2022] DELETE /identity/v3/projects/3aae8105b1e440e7873e5ee2dfa14c93 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:38.785680 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e54c-7139-4260-8791-2c29b151aebc None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:38.786315 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e54c-7139-4260-8791-2c29b151aebc None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:38.786995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e54c-7139-4260-8791-2c29b151aebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:38.822453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-a500e54c-7139-4260-8791-2c29b151aebc None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:38.824821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a500e54c-7139-4260-8791-2c29b151aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:38.919126 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1414/2823] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:38.927787 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f547-11e1-4c0a-9511-dabe5e7bf3be None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:38.928086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f547-11e1-4c0a-9511-dabe5e7bf3be None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:38.928366 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8f547-11e1-4c0a-9511-dabe5e7bf3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:38.952195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5cc8f547-11e1-4c0a-9511-dabe5e7bf3be None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:38.953506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5cc8f547-11e1-4c0a-9511-dabe5e7bf3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:38.962363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1410/2824] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:50:38.966856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500e54c-7139-4260-8791-2c29b151aebc None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:38.977400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500e54c-7139-4260-8791-2c29b151aebc None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:38.983032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:38.983662 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:38.983943 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:38.984216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:38.984886 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:50:38.985194 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:38.986890 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:39.002150 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1415/2825] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:50:39.007023 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8f547-11e1-4c0a-9511-dabe5e7bf3be None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:39.017556 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8f547-11e1-4c0a-9511-dabe5e7bf3be None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:39.022940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83ace8-6252-4722-98e3-147df050a9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:39.023724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83ace8-6252-4722-98e3-147df050a9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:39.024129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83ace8-6252-4722-98e3-147df050a9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:39.024587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83ace8-6252-4722-98e3-147df050a9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:39.025325 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83ace8-6252-4722-98e3-147df050a9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:39.028307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83ace8-6252-4722-98e3-147df050a9b3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:39.149915 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1411/2826] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:50:39 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:39.155406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:39.166196 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9181972-b8de-4d1e-887f-ec9a67c02d6a admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:39.229459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148a71-87ae-47a0-8784-fee7d3b31309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:39.230294 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148a71-87ae-47a0-8784-fee7d3b31309 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:39.230714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148a71-87ae-47a0-8784-fee7d3b31309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:39.231147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148a71-87ae-47a0-8784-fee7d3b31309 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:39.232280 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd148a71-87ae-47a0-8784-fee7d3b31309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:39.235566 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd148a71-87ae-47a0-8784-fee7d3b31309 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:39.246725 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:39.327527 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1416/2827] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:50:39 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:39.333002 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83ace8-6252-4722-98e3-147df050a9b3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:39.344499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83ace8-6252-4722-98e3-147df050a9b3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:39.350222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63968a7-961c-4828-8248-bbcf3a38514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:39.350222 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63968a7-961c-4828-8248-bbcf3a38514a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:39.350581 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63968a7-961c-4828-8248-bbcf3a38514a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:39.350726 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63968a7-961c-4828-8248-bbcf3a38514a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:39.351375 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63968a7-961c-4828-8248-bbcf3a38514a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:39.353010 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63968a7-961c-4828-8248-bbcf3a38514a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:39.364275 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1412/2828] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:39.368636 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148a71-87ae-47a0-8784-fee7d3b31309 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:39.379657 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148a71-87ae-47a0-8784-fee7d3b31309 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:39.384466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d200b-50c3-4d0e-b6ce-b3a73cce7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:39.385076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d200b-50c3-4d0e-b6ce-b3a73cce7d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:39.385353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d200b-50c3-4d0e-b6ce-b3a73cce7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:39.386415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d200b-50c3-4d0e-b6ce-b3a73cce7d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:39.386937 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d200b-50c3-4d0e-b6ce-b3a73cce7d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:39.388543 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d200b-50c3-4d0e-b6ce-b3a73cce7d06 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:39.400039 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1417/2829] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:39.404833 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63968a7-961c-4828-8248-bbcf3a38514a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:39.415485 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63968a7-961c-4828-8248-bbcf3a38514a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:39.421224 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:39.421900 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:39.422218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:39.422495 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] PATH_INFO: `/v3/projects/ffe2df2dd1e94d58ab9573c3b0909e1e/users/64048b05da4c40849747278fac250c37/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:39.440254 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe2df2dd1e94d58ab9573c3b0909e1e, user_id=64048b05da4c40849747278fac250c37, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:39.442972 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:39.526234 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1413/2830] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:50:39 2022] PUT /identity/v3/projects/ffe2df2dd1e94d58ab9573c3b0909e1e/users/64048b05da4c40849747278fac250c37/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:50:39.543371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddf12f-6e01-4c69-9cc6-98745d39cd75 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:39.544405 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddf12f-6e01-4c69-9cc6-98745d39cd75 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:39.544889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddf12f-6e01-4c69-9cc6-98745d39cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:39.576626 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-39ddf12f-6e01-4c69-9cc6-98745d39cd75 None None] MFA Rules not processed for user `64048b05da4c40849747278fac250c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:39.577885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-39ddf12f-6e01-4c69-9cc6-98745d39cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:39.646847 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1418/2831] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:39.658708 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:39.660519 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:39.728253 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59e6f8-03c0-4718-99b3-49a5e4d3244e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:39.732468 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6317-4c48-4cba-95b0-4f9d639e7130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:39.734672 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6317-4c48-4cba-95b0-4f9d639e7130 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:39.736796 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6317-4c48-4cba-95b0-4f9d639e7130 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:39.737087 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6317-4c48-4cba-95b0-4f9d639e7130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:39.753902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6317-4c48-4cba-95b0-4f9d639e7130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:39.755404 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6317-4c48-4cba-95b0-4f9d639e7130 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:39.766352 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1414/2832] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:50:49.643807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:49.761410 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=3,keystone:SELECT=63,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:50.146546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddf12f-6e01-4c69-9cc6-98745d39cd75 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:50.214416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddf12f-6e01-4c69-9cc6-98745d39cd75 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:50.219231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:50.219889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:50.220169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:50.220444 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] PATH_INFO: `/v3/users/64048b05da4c40849747278fac250c37` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:50.221643 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64048b05da4c40849747278fac250c37)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:50.223670 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:50.374283 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64048b05da4c40849747278fac250c37'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:50.375165 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64048b05da4c40849747278fac250c37'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:50.382804 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64048b05da4c40849747278fac250c37'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:50.395919 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64048b05da4c40849747278fac250c37'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:50.396656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64048b05da4c40849747278fac250c37'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:50.480423 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1419/2833] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:50:50 2022] DELETE /identity/v3/users/64048b05da4c40849747278fac250c37 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:50.486536 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7bdad-cb58-40de-b246-bf41482740db None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:50.493235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7bdad-cb58-40de-b246-bf41482740db None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:50.493235 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7bdad-cb58-40de-b246-bf41482740db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:50.511028 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6ef7bdad-cb58-40de-b246-bf41482740db None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:50.512312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6ef7bdad-cb58-40de-b246-bf41482740db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:50.579976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1415/2834] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:50.591872 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:50.593528 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:50.662780 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ca90-9172-42bb-9577-e3162959d421 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:50.667855 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10236394-a6d7-471e-bf07-9e002615b7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:50.668573 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10236394-a6d7-471e-bf07-9e002615b7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:50.668885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10236394-a6d7-471e-bf07-9e002615b7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:50.669212 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10236394-a6d7-471e-bf07-9e002615b7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:50.680078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10236394-a6d7-471e-bf07-9e002615b7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:50.681517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10236394-a6d7-471e-bf07-9e002615b7a7 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:50.692192 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1420/2835] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:50:51.162522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7bdad-cb58-40de-b246-bf41482740db None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:51.169687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6ef7bdad-cb58-40de-b246-bf41482740db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:51.181788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7bdad-cb58-40de-b246-bf41482740db None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:51.187860 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:51.188490 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:51.188767 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:51.189030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] PATH_INFO: `/v3/projects/ffe2df2dd1e94d58ab9573c3b0909e1e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:51.190288 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe2df2dd1e94d58ab9573c3b0909e1e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:51.192237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:51.339407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe2df2dd1e94d58ab9573c3b0909e1e', 'request_id': 'req-6893c3e9-f49f-420a-9279-a91c1f137111'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:51.450826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe2df2dd1e94d58ab9573c3b0909e1e', 'request_id': 'req-6893c3e9-f49f-420a-9279-a91c1f137111'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:51.457332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe2df2dd1e94d58ab9573c3b0909e1e', 'request_id': 'req-6893c3e9-f49f-420a-9279-a91c1f137111'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:51.470686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] The token cache is being invalidate because project ffe2df2dd1e94d58ab9573c3b0909e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:50:51.470990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:51.471698 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6893c3e9-f49f-420a-9279-a91c1f137111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:51.473294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1416/2836] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:50:51 2022] DELETE /identity/v3/projects/ffe2df2dd1e94d58ab9573c3b0909e1e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:51.478552 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ba05-4218-4a59-829b-2507bff4b64e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:51.478835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ba05-4218-4a59-829b-2507bff4b64e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:51.479443 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ba05-4218-4a59-829b-2507bff4b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:51.502416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-23a0ba05-4218-4a59-829b-2507bff4b64e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:51.503714 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-23a0ba05-4218-4a59-829b-2507bff4b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:51.524461 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:51.575852 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1421/2837] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:51.585181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47655d6-6b8d-42a5-9d28-e2d3c1502172 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:51.585680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47655d6-6b8d-42a5-9d28-e2d3c1502172 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:51.586229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47655d6-6b8d-42a5-9d28-e2d3c1502172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:51.618935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a47655d6-6b8d-42a5-9d28-e2d3c1502172 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:51.620904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a47655d6-6b8d-42a5-9d28-e2d3c1502172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:51.634411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1417/2838] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:51.639946 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0ba05-4218-4a59-829b-2507bff4b64e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:51.650326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0ba05-4218-4a59-829b-2507bff4b64e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:51.655953 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:51.656605 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:51.656885 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:51.657155 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:51.657819 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:50:51.658156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:51.659766 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:51.674479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1422/2839] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:50:51.679540 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47655d6-6b8d-42a5-9d28-e2d3c1502172 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:51.689259 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47655d6-6b8d-42a5-9d28-e2d3c1502172 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:51.694189 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63d0ba-69a1-414c-9997-e17bd25d0b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:51.694806 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63d0ba-69a1-414c-9997-e17bd25d0b0c admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:51.695088 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63d0ba-69a1-414c-9997-e17bd25d0b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:51.695365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63d0ba-69a1-414c-9997-e17bd25d0b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:51.696016 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63d0ba-69a1-414c-9997-e17bd25d0b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:51.698492 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63d0ba-69a1-414c-9997-e17bd25d0b0c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:51.795627 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1418/2840] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:50:51 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:51.800554 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:51.811514 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aede0fa-60b8-451b-9d09-62f8a7120234 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:51.882370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8957d3-d408-4842-a482-c89f7d2f76fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:51.882998 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8957d3-d408-4842-a482-c89f7d2f76fc admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:51.883276 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8957d3-d408-4842-a482-c89f7d2f76fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:51.883546 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8957d3-d408-4842-a482-c89f7d2f76fc admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:51.884234 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8957d3-d408-4842-a482-c89f7d2f76fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:51.887297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8957d3-d408-4842-a482-c89f7d2f76fc admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:51.982572 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1423/2841] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:50:51 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:51.987231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63d0ba-69a1-414c-9997-e17bd25d0b0c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:51.998924 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63d0ba-69a1-414c-9997-e17bd25d0b0c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.003685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a26126-95a7-4e5b-8dc4-ab118916f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.004294 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a26126-95a7-4e5b-8dc4-ab118916f172 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.004574 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a26126-95a7-4e5b-8dc4-ab118916f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.004848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a26126-95a7-4e5b-8dc4-ab118916f172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.005493 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a26126-95a7-4e5b-8dc4-ab118916f172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.007118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a26126-95a7-4e5b-8dc4-ab118916f172 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:52.018473 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1419/2842] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:50:52.022779 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8957d3-d408-4842-a482-c89f7d2f76fc admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:52.033894 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8957d3-d408-4842-a482-c89f7d2f76fc admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.038675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661df0f-2219-4cc3-93b6-5c14abf757c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.039282 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661df0f-2219-4cc3-93b6-5c14abf757c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.039575 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661df0f-2219-4cc3-93b6-5c14abf757c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.039830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661df0f-2219-4cc3-93b6-5c14abf757c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.040471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661df0f-2219-4cc3-93b6-5c14abf757c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.042104 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661df0f-2219-4cc3-93b6-5c14abf757c1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:52.053834 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1424/2843] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:52.059000 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a26126-95a7-4e5b-8dc4-ab118916f172 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:52.069604 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a26126-95a7-4e5b-8dc4-ab118916f172 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.075181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150d1b-204a-44cf-b00c-897f6e53d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.075848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150d1b-204a-44cf-b00c-897f6e53d65e admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.076130 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150d1b-204a-44cf-b00c-897f6e53d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.076408 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a150d1b-204a-44cf-b00c-897f6e53d65e admin admin] PATH_INFO: `/v3/projects/ecc84cc10ebd4ab087d6cbd752ef59e5/users/58739786892b444b82d02e8216203f7f/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.093709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a150d1b-204a-44cf-b00c-897f6e53d65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc84cc10ebd4ab087d6cbd752ef59e5, user_id=58739786892b444b82d02e8216203f7f, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.096457 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a150d1b-204a-44cf-b00c-897f6e53d65e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:52.193850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1420/2844] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:50:52 2022] PUT /identity/v3/projects/ecc84cc10ebd4ab087d6cbd752ef59e5/users/58739786892b444b82d02e8216203f7f/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:50:52.205468 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0b92-b4b6-4459-adb9-f645e6fd1bf4 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.205754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0b92-b4b6-4459-adb9-f645e6fd1bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.206068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0b92-b4b6-4459-adb9-f645e6fd1bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.238317 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-d97c0b92-b4b6-4459-adb9-f645e6fd1bf4 None None] MFA Rules not processed for user `58739786892b444b82d02e8216203f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:52.239518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-d97c0b92-b4b6-4459-adb9-f645e6fd1bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:52.309898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1425/2845] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:52.315030 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150d1b-204a-44cf-b00c-897f6e53d65e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:52.338312 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:52.381889 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a150d1b-204a-44cf-b00c-897f6e53d65e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.387208 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd08d-eee6-4fcd-b145-212c0ece1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.387813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd08d-eee6-4fcd-b145-212c0ece1018 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.388092 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd08d-eee6-4fcd-b145-212c0ece1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.388362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd08d-eee6-4fcd-b145-212c0ece1018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.388996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fd08d-eee6-4fcd-b145-212c0ece1018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.390935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609fd08d-eee6-4fcd-b145-212c0ece1018 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:52.475438 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1421/2846] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:50:52 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 22 14:50:52.480161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c0b92-b4b6-4459-adb9-f645e6fd1bf4 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:52.491359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c0b92-b4b6-4459-adb9-f645e6fd1bf4 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.504738 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:52.551613 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8d84d-fe1e-43b9-9c8e-ae3bcce0cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.552281 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d84d-fe1e-43b9-9c8e-ae3bcce0cda8 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.552564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d84d-fe1e-43b9-9c8e-ae3bcce0cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.552839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d84d-fe1e-43b9-9c8e-ae3bcce0cda8 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.553749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8d84d-fe1e-43b9-9c8e-ae3bcce0cda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.555717 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8d84d-fe1e-43b9-9c8e-ae3bcce0cda8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:52.679986 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1426/2847] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:50:52 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:52.685834 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd08d-eee6-4fcd-b145-212c0ece1018 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:52.697721 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd08d-eee6-4fcd-b145-212c0ece1018 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.703850 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f2fca-992f-4278-8e28-0695f2006df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.704465 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2fca-992f-4278-8e28-0695f2006df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.704754 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2fca-992f-4278-8e28-0695f2006df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.705110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f2fca-992f-4278-8e28-0695f2006df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.705760 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f2fca-992f-4278-8e28-0695f2006df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.707411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f2fca-992f-4278-8e28-0695f2006df9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:52.720854 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1422/2848] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:52.725493 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8d84d-fe1e-43b9-9c8e-ae3bcce0cda8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:52.736020 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8d84d-fe1e-43b9-9c8e-ae3bcce0cda8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.740749 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6435-ef28-4d9a-bd49-1015616f8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.741406 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6435-ef28-4d9a-bd49-1015616f8d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.741683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6435-ef28-4d9a-bd49-1015616f8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.741954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6435-ef28-4d9a-bd49-1015616f8d3c admin admin] PATH_INFO: `/v3/projects/2cba4b95ebf64c619268e845e1f3b88c/users/66f44bf48d2149c0887824b5862276a1/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.758706 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d6435-ef28-4d9a-bd49-1015616f8d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cba4b95ebf64c619268e845e1f3b88c, user_id=66f44bf48d2149c0887824b5862276a1, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.762262 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d6435-ef28-4d9a-bd49-1015616f8d3c admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:52.874748 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1427/2849] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:50:52 2022] PUT /identity/v3/projects/2cba4b95ebf64c619268e845e1f3b88c/users/66f44bf48d2149c0887824b5862276a1/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:50:52.878937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f2fca-992f-4278-8e28-0695f2006df9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:52.890231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f2fca-992f-4278-8e28-0695f2006df9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.956809 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbcca7-64a6-4369-8231-be82574af41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.957341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbcca7-64a6-4369-8231-be82574af41a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.957629 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbcca7-64a6-4369-8231-be82574af41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.957904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbcca7-64a6-4369-8231-be82574af41a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.958601 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbcca7-64a6-4369-8231-be82574af41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.960229 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbcca7-64a6-4369-8231-be82574af41a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:52.971285 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1423/2850] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:52.977160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6435-ef28-4d9a-bd49-1015616f8d3c admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:52.986979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6435-ef28-4d9a-bd49-1015616f8d3c admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:52.991889 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:52.992622 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:52.993027 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:52.993422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] PATH_INFO: `/v3/projects/2cba4b95ebf64c619268e845e1f3b88c/users/66f44bf48d2149c0887824b5862276a1/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:52.996173 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cba4b95ebf64c619268e845e1f3b88c, user_id=66f44bf48d2149c0887824b5862276a1, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:52.999211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:53.011158 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1428/2851] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:50:52 2022] PUT /identity/v3/projects/2cba4b95ebf64c619268e845e1f3b88c/users/66f44bf48d2149c0887824b5862276a1/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:53.023709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539625c7-85b6-46b3-824c-1ba130ae5fc1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:53.023976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539625c7-85b6-46b3-824c-1ba130ae5fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:53.024242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539625c7-85b6-46b3-824c-1ba130ae5fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:53.055621 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-539625c7-85b6-46b3-824c-1ba130ae5fc1 None None] MFA Rules not processed for user `66f44bf48d2149c0887824b5862276a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:53.056859 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-539625c7-85b6-46b3-824c-1ba130ae5fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:53.137009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1424/2852] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:53.149693 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:53.152700 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:53.224407 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593fd6-4140-4fc5-b862-c5051a0fe549 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:53.228438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501c713-20b0-4d79-8324-15550822ca3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:53.229181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c713-20b0-4d79-8324-15550822ca3b service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:53.229658 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c713-20b0-4d79-8324-15550822ca3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:53.230077 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c713-20b0-4d79-8324-15550822ca3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:53.241521 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501c713-20b0-4d79-8324-15550822ca3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:53.243011 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501c713-20b0-4d79-8324-15550822ca3b service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:53.253718 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1429/2853] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:50:54.360880 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539625c7-85b6-46b3-824c-1ba130ae5fc1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:54.381788 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:54.441954 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539625c7-85b6-46b3-824c-1ba130ae5fc1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:54.446934 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:54.448249 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:54.448620 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:54.449058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] PATH_INFO: `/v3/users/58739786892b444b82d02e8216203f7f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:54.450505 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58739786892b444b82d02e8216203f7f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:54.452452 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:54.614142 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58739786892b444b82d02e8216203f7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:54.628344 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58739786892b444b82d02e8216203f7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:54.695891 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58739786892b444b82d02e8216203f7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:54.696530 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58739786892b444b82d02e8216203f7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:54.705693 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58739786892b444b82d02e8216203f7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:54.712158 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1425/2854] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:50:54 2022] DELETE /identity/v3/users/58739786892b444b82d02e8216203f7f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:54.718298 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48765327-0ee2-4c62-800a-e8e2b52e9726 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:54.718869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48765327-0ee2-4c62-800a-e8e2b52e9726 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:54.718869 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48765327-0ee2-4c62-800a-e8e2b52e9726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:54.738146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-48765327-0ee2-4c62-800a-e8e2b52e9726 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:54.739382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-48765327-0ee2-4c62-800a-e8e2b52e9726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:54.827229 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1430/2855] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:54.837557 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:54.839800 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:54.911511 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526873f-7e4e-4fcc-9bd1-9bfe0844c7f6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:54.915510 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d9f05-63ff-4591-bff5-63116c981798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:54.916171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9f05-63ff-4591-bff5-63116c981798 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:54.916491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9f05-63ff-4591-bff5-63116c981798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:54.916773 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d9f05-63ff-4591-bff5-63116c981798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:54.927421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d9f05-63ff-4591-bff5-63116c981798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:54.929216 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d9f05-63ff-4591-bff5-63116c981798 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:54.941340 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1426/2856] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:50:55.458797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48765327-0ee2-4c62-800a-e8e2b52e9726 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:55.460550 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-48765327-0ee2-4c62-800a-e8e2b52e9726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:55.476809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48765327-0ee2-4c62-800a-e8e2b52e9726 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:55.484859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:55.486007 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:55.491201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:55.491201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] PATH_INFO: `/v3/projects/ecc84cc10ebd4ab087d6cbd752ef59e5` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:55.491201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc84cc10ebd4ab087d6cbd752ef59e5)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:55.491201 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:55.503134 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:55.609742 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc84cc10ebd4ab087d6cbd752ef59e5', 'request_id': 'req-9efbada0-a51c-482e-b420-020435587084'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:55.662149 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc84cc10ebd4ab087d6cbd752ef59e5', 'request_id': 'req-9efbada0-a51c-482e-b420-020435587084'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:55.670050 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc84cc10ebd4ab087d6cbd752ef59e5', 'request_id': 'req-9efbada0-a51c-482e-b420-020435587084'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:55.682226 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] The token cache is being invalidate because project ecc84cc10ebd4ab087d6cbd752ef59e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:50:55.682511 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:55.683301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:55.684802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1431/2857] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:50:55 2022] DELETE /identity/v3/projects/ecc84cc10ebd4ab087d6cbd752ef59e5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:55.689161 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d9f05-63ff-4591-bff5-63116c981798 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:55.699262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d9f05-63ff-4591-bff5-63116c981798 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:55.736680 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:55.763848 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:55.764494 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:55.764776 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:55.765131 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] PATH_INFO: `/v3/users/66f44bf48d2149c0887824b5862276a1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:55.766638 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f44bf48d2149c0887824b5862276a1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:55.769061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:55.982685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f44bf48d2149c0887824b5862276a1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:55.996759 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f44bf48d2149c0887824b5862276a1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.067571 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f44bf48d2149c0887824b5862276a1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.068223 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f44bf48d2149c0887824b5862276a1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.077245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-522b1b9e-7756-4eab-baba-4e778933cb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f44bf48d2149c0887824b5862276a1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.084086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1427/2858] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:50:55 2022] DELETE /identity/v3/users/66f44bf48d2149c0887824b5862276a1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:56.521912 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:56.523631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:56.541353 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbada0-a51c-482e-b420-020435587084 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:56.607306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:56.608016 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:56.609096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:56.609096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] PATH_INFO: `/v3/projects/2cba4b95ebf64c619268e845e1f3b88c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:56.610145 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cba4b95ebf64c619268e845e1f3b88c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:56.612122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:56.711430 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cba4b95ebf64c619268e845e1f3b88c', 'request_id': 'req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.775729 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cba4b95ebf64c619268e845e1f3b88c', 'request_id': 'req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.782979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cba4b95ebf64c619268e845e1f3b88c', 'request_id': 'req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.794442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] The token cache is being invalidate because project 2cba4b95ebf64c619268e845e1f3b88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:50:56.794733 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.795412 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-fb78f8da-18a0-4a6a-afc7-9bcc4d5d59fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:50:56.796882 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1432/2859] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:50:56 2022] DELETE /identity/v3/projects/2cba4b95ebf64c619268e845e1f3b88c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:56.801744 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8baa67-9792-4f76-aad1-a47b197578d2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:56.802364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8baa67-9792-4f76-aad1-a47b197578d2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:56.802364 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8baa67-9792-4f76-aad1-a47b197578d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:56.823424 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ce8baa67-9792-4f76-aad1-a47b197578d2 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:56.824647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ce8baa67-9792-4f76-aad1-a47b197578d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:56.885657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1428/2860] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:50:56.893827 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5deb7-516c-414b-961a-f5c14f48b92c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:56.894258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5deb7-516c-414b-961a-f5c14f48b92c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:56.894672 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5deb7-516c-414b-961a-f5c14f48b92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:56.915642 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-3df5deb7-516c-414b-961a-f5c14f48b92c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:56.917455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-3df5deb7-516c-414b-961a-f5c14f48b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:56.925378 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1433/2861] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:56.930136 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8baa67-9792-4f76-aad1-a47b197578d2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:56.941114 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8baa67-9792-4f76-aad1-a47b197578d2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:56.946129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:56.946791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:56.947191 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:56.947658 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:56.948277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:50:56.948619 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:56.950405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:56.962422 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1429/2862] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:50:56.968032 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5deb7-516c-414b-961a-f5c14f48b92c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:56.978345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5deb7-516c-414b-961a-f5c14f48b92c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:56.984711 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb365d9-a77f-46f6-a8e9-560620e20197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:56.985377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb365d9-a77f-46f6-a8e9-560620e20197 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:56.985656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb365d9-a77f-46f6-a8e9-560620e20197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:56.985929 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb365d9-a77f-46f6-a8e9-560620e20197 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:56.986630 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb365d9-a77f-46f6-a8e9-560620e20197 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:56.988607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb365d9-a77f-46f6-a8e9-560620e20197 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:57.080186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:57.087683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1434/2863] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:50:56 2022] POST /identity/v3/projects => generated 409 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:57.093029 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:57.104264 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea0d5d-ea97-476f-8dee-6bcae86b3e62 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:57.153622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:57.170890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd58706-3331-4965-9e69-27f83671e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:57.171547 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58706-3331-4965-9e69-27f83671e8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:57.171830 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58706-3331-4965-9e69-27f83671e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:57.172106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58706-3331-4965-9e69-27f83671e8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:57.172757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd58706-3331-4965-9e69-27f83671e8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:57.174764 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd58706-3331-4965-9e69-27f83671e8f8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:57.298439 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1430/2864] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:50:57 2022] POST /identity/v3/users => generated 305 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:57.302975 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb365d9-a77f-46f6-a8e9-560620e20197 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:57.315203 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb365d9-a77f-46f6-a8e9-560620e20197 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:57.320074 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4287-9407-46b9-a1ea-db5a79c00322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:57.320687 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4287-9407-46b9-a1ea-db5a79c00322 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:57.320971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4287-9407-46b9-a1ea-db5a79c00322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:57.321241 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee4287-9407-46b9-a1ea-db5a79c00322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:57.321997 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee4287-9407-46b9-a1ea-db5a79c00322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:57.324160 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee4287-9407-46b9-a1ea-db5a79c00322 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:57.336096 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1435/2865] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:57.340384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd58706-3331-4965-9e69-27f83671e8f8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:57.351362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd58706-3331-4965-9e69-27f83671e8f8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:57.357642 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca2be6-8b04-4bb8-b35f-36b2c3ddf058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:57.359263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2be6-8b04-4bb8-b35f-36b2c3ddf058 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:57.359263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2be6-8b04-4bb8-b35f-36b2c3ddf058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:57.359263 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2be6-8b04-4bb8-b35f-36b2c3ddf058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:57.359652 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca2be6-8b04-4bb8-b35f-36b2c3ddf058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:57.361053 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca2be6-8b04-4bb8-b35f-36b2c3ddf058 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:57.373474 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1431/2866] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:57.379802 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4287-9407-46b9-a1ea-db5a79c00322 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:57.396931 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee4287-9407-46b9-a1ea-db5a79c00322 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:57.405277 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51835a0-c37e-42cd-abb6-2a418dfbef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:57.406397 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51835a0-c37e-42cd-abb6-2a418dfbef7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:57.406881 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51835a0-c37e-42cd-abb6-2a418dfbef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:57.407387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51835a0-c37e-42cd-abb6-2a418dfbef7b admin admin] PATH_INFO: `/v3/projects/bfb1f2360aff4d098df5cab02d0030da/users/43de3dddbc254729895d1bfd03586292/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:57.429130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51835a0-c37e-42cd-abb6-2a418dfbef7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb1f2360aff4d098df5cab02d0030da, user_id=43de3dddbc254729895d1bfd03586292, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:57.431830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51835a0-c37e-42cd-abb6-2a418dfbef7b admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:57.490773 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1436/2867] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:50:57 2022] PUT /identity/v3/projects/bfb1f2360aff4d098df5cab02d0030da/users/43de3dddbc254729895d1bfd03586292/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:57.502736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48d82-9d5b-4203-b800-1b669e9c72f7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:57.503025 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48d82-9d5b-4203-b800-1b669e9c72f7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:57.503281 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec48d82-9d5b-4203-b800-1b669e9c72f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:57.539184 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8ec48d82-9d5b-4203-b800-1b669e9c72f7 None None] MFA Rules not processed for user `43de3dddbc254729895d1bfd03586292`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:57.540870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8ec48d82-9d5b-4203-b800-1b669e9c72f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:57.656683 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1432/2868] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:57.661343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51835a0-c37e-42cd-abb6-2a418dfbef7b admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:57.729425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51835a0-c37e-42cd-abb6-2a418dfbef7b admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:57.734200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4e821-4e9c-441d-b7b6-a356a4a5ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:57.734811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4e821-4e9c-441d-b7b6-a356a4a5ec6e admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:57.735088 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4e821-4e9c-441d-b7b6-a356a4a5ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:57.735361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4e821-4e9c-441d-b7b6-a356a4a5ec6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:57.736005 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4e821-4e9c-441d-b7b6-a356a4a5ec6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:57.737898 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4e821-4e9c-441d-b7b6-a356a4a5ec6e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:57.881180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1437/2869] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:50:57 2022] POST /identity/v3/projects => generated 409 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:57.886462 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec48d82-9d5b-4203-b800-1b669e9c72f7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:57.898831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec48d82-9d5b-4203-b800-1b669e9c72f7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:57.979213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40334c0-144f-4f2f-a2a5-5a1ced593bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:57.979749 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40334c0-144f-4f2f-a2a5-5a1ced593bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:57.980024 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40334c0-144f-4f2f-a2a5-5a1ced593bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:57.980298 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40334c0-144f-4f2f-a2a5-5a1ced593bcb admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:57.980946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40334c0-144f-4f2f-a2a5-5a1ced593bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:57.982903 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40334c0-144f-4f2f-a2a5-5a1ced593bcb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:58.067541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1433/2870] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:50:57 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:50:58.071893 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4e821-4e9c-441d-b7b6-a356a4a5ec6e admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:58.083971 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4e821-4e9c-441d-b7b6-a356a4a5ec6e admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:58.092745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979ea23-a1d7-4181-9bbf-d0628cc07b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:58.092745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979ea23-a1d7-4181-9bbf-d0628cc07b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:58.092745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979ea23-a1d7-4181-9bbf-d0628cc07b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:58.092745 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979ea23-a1d7-4181-9bbf-d0628cc07b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:58.093195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979ea23-a1d7-4181-9bbf-d0628cc07b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:58.093195 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979ea23-a1d7-4181-9bbf-d0628cc07b27 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:58.103351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1438/2871] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:58.109421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40334c0-144f-4f2f-a2a5-5a1ced593bcb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:58.121428 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40334c0-144f-4f2f-a2a5-5a1ced593bcb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:58.126623 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419131d1-bc2f-405c-8448-e6695528fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:58.127295 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419131d1-bc2f-405c-8448-e6695528fb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:58.127595 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419131d1-bc2f-405c-8448-e6695528fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:58.127864 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419131d1-bc2f-405c-8448-e6695528fb35 admin admin] PATH_INFO: `/v3/projects/4069db36a5de4906bdba8b9d2c86feb1/users/d3b6e19383884e778ce81cec83cdefba/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:58.146582 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419131d1-bc2f-405c-8448-e6695528fb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4069db36a5de4906bdba8b9d2c86feb1, user_id=d3b6e19383884e778ce81cec83cdefba, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:58.149237 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419131d1-bc2f-405c-8448-e6695528fb35 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:58.223181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1434/2872] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:50:58 2022] PUT /identity/v3/projects/4069db36a5de4906bdba8b9d2c86feb1/users/d3b6e19383884e778ce81cec83cdefba/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:50:58.227387 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979ea23-a1d7-4181-9bbf-d0628cc07b27 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:58.238472 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979ea23-a1d7-4181-9bbf-d0628cc07b27 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:58.303990 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a35925-27eb-4400-bc08-dc652ce8e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:58.304666 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35925-27eb-4400-bc08-dc652ce8e83e admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:58.304948 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35925-27eb-4400-bc08-dc652ce8e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:58.305221 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a35925-27eb-4400-bc08-dc652ce8e83e admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:58.305878 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35925-27eb-4400-bc08-dc652ce8e83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:58.308592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a35925-27eb-4400-bc08-dc652ce8e83e admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:58.319398 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1439/2873] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:50:58.324600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419131d1-bc2f-405c-8448-e6695528fb35 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:58.335552 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419131d1-bc2f-405c-8448-e6695528fb35 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:58.340665 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:58.341343 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:58.341624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:58.341902 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] PATH_INFO: `/v3/projects/4069db36a5de4906bdba8b9d2c86feb1/users/d3b6e19383884e778ce81cec83cdefba/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:58.344332 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4069db36a5de4906bdba8b9d2c86feb1, user_id=d3b6e19383884e778ce81cec83cdefba, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:58.347091 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:58.359061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1435/2874] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:50:58 2022] PUT /identity/v3/projects/4069db36a5de4906bdba8b9d2c86feb1/users/d3b6e19383884e778ce81cec83cdefba/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:50:58.426866 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd45bc7-7cf9-4508-be5d-46d092bb52de None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:58.427478 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd45bc7-7cf9-4508-be5d-46d092bb52de None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:58.427810 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd45bc7-7cf9-4508-be5d-46d092bb52de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:58.459012 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-4cd45bc7-7cf9-4508-be5d-46d092bb52de None None] MFA Rules not processed for user `d3b6e19383884e778ce81cec83cdefba`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:50:58.460268 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-4cd45bc7-7cf9-4508-be5d-46d092bb52de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:58.482221 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:58.548326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1440/2875] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:50:58.562163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:58.564594 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:50:58.575151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:50:58.647624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd928012-7beb-4d18-b022-be2e262190a8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:58.652267 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24fe4a-f39a-47df-a8e9-cc99c6eaaceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:58.652904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24fe4a-f39a-47df-a8e9-cc99c6eaaceb service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:58.653177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24fe4a-f39a-47df-a8e9-cc99c6eaaceb service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:58.653449 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24fe4a-f39a-47df-a8e9-cc99c6eaaceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:58.664135 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24fe4a-f39a-47df-a8e9-cc99c6eaaceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:58.665610 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24fe4a-f39a-47df-a8e9-cc99c6eaaceb service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:58.677635 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1436/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:50:58.990930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd45bc7-7cf9-4508-be5d-46d092bb52de None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:50:59.002231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd45bc7-7cf9-4508-be5d-46d092bb52de None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:50:59.006093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5c41a-a073-4984-8fe9-f67a711f7d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:50:59.006708 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c41a-a073-4984-8fe9-f67a711f7d0d service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:50:59.006977 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c41a-a073-4984-8fe9-f67a711f7d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:50:59.007235 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c41a-a073-4984-8fe9-f67a711f7d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:50:59.071361 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5c41a-a073-4984-8fe9-f67a711f7d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:50:59.073382 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5c41a-a073-4984-8fe9-f67a711f7d0d service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:50:59.083983 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1441/2877] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:06.055177 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24fe4a-f39a-47df-a8e9-cc99c6eaaceb service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:06.137846 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24fe4a-f39a-47df-a8e9-cc99c6eaaceb service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:06.143207 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:06.143964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:06.144289 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:06.144615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] PATH_INFO: `/v3/users/43de3dddbc254729895d1bfd03586292` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:06.145885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=43de3dddbc254729895d1bfd03586292)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:06.149471 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:06.335612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43de3dddbc254729895d1bfd03586292'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:06.350599 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43de3dddbc254729895d1bfd03586292'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:06.415990 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43de3dddbc254729895d1bfd03586292'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:06.416765 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43de3dddbc254729895d1bfd03586292'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:06.425607 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43de3dddbc254729895d1bfd03586292'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:06.434209 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1437/2878] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:51:06 2022] DELETE /identity/v3/users/43de3dddbc254729895d1bfd03586292 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:06.439428 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecd696-3354-4065-bcfe-0dfb27b8313d None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:06.440046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecd696-3354-4065-bcfe-0dfb27b8313d None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:06.440046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecd696-3354-4065-bcfe-0dfb27b8313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:06.462935 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-dfecd696-3354-4065-bcfe-0dfb27b8313d None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:06.464199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dfecd696-3354-4065-bcfe-0dfb27b8313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:06.524758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1442/2879] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:51:06.535171 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:06.536779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:06.571579 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:06.599821 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56808422-5705-421b-9eb8-b21a20431cbf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:06.604797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88a88a-88ec-40d0-8673-9374ffeff74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:06.605427 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88a88a-88ec-40d0-8673-9374ffeff74b service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:06.605703 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88a88a-88ec-40d0-8673-9374ffeff74b service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:06.606014 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88a88a-88ec-40d0-8673-9374ffeff74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:06.616036 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88a88a-88ec-40d0-8673-9374ffeff74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:06.617477 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88a88a-88ec-40d0-8673-9374ffeff74b service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:06.628479 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1438/2880] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:07.071216 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecd696-3354-4065-bcfe-0dfb27b8313d None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:07.072888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-dfecd696-3354-4065-bcfe-0dfb27b8313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:07.089102 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecd696-3354-4065-bcfe-0dfb27b8313d None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:07.098058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:07.098058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:07.098058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:07.098058 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] PATH_INFO: `/v3/projects/bfb1f2360aff4d098df5cab02d0030da` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:07.098496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb1f2360aff4d098df5cab02d0030da)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:07.098496 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:07.218264 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb1f2360aff4d098df5cab02d0030da', 'request_id': 'req-a53385cf-8e25-4581-a6cc-c59f46b0ce15'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.221348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:07.359178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb1f2360aff4d098df5cab02d0030da', 'request_id': 'req-a53385cf-8e25-4581-a6cc-c59f46b0ce15'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.366883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb1f2360aff4d098df5cab02d0030da', 'request_id': 'req-a53385cf-8e25-4581-a6cc-c59f46b0ce15'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.378858 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] The token cache is being invalidate because project bfb1f2360aff4d098df5cab02d0030da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:51:07.379141 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.379835 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.382347 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1443/2881] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:51:07 2022] DELETE /identity/v3/projects/bfb1f2360aff4d098df5cab02d0030da => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:07.388791 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88a88a-88ec-40d0-8673-9374ffeff74b service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:07.399818 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88a88a-88ec-40d0-8673-9374ffeff74b service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:07.460307 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:07.460940 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:07.461214 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:07.461483 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] PATH_INFO: `/v3/users/d3b6e19383884e778ce81cec83cdefba` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:07.462657 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b6e19383884e778ce81cec83cdefba)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:07.465126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:07.722231 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b6e19383884e778ce81cec83cdefba'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.734939 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b6e19383884e778ce81cec83cdefba'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.810262 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b6e19383884e778ce81cec83cdefba'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.810885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b6e19383884e778ce81cec83cdefba'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.819411 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-312ef591-73f1-4475-a880-b9f80013d513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b6e19383884e778ce81cec83cdefba'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:07.830771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1439/2882] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:51:07 2022] DELETE /identity/v3/users/d3b6e19383884e778ce81cec83cdefba => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:08.293301 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:08.295518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:08.317237 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53385cf-8e25-4581-a6cc-c59f46b0ce15 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:08.386954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:08.387683 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:08.387958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:08.388225 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] PATH_INFO: `/v3/projects/4069db36a5de4906bdba8b9d2c86feb1` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:08.389380 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4069db36a5de4906bdba8b9d2c86feb1)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:08.391374 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:08.532211 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4069db36a5de4906bdba8b9d2c86feb1', 'request_id': 'req-4bca01e7-a202-4eaf-b1f7-74970293bc88'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:08.605567 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4069db36a5de4906bdba8b9d2c86feb1', 'request_id': 'req-4bca01e7-a202-4eaf-b1f7-74970293bc88'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:08.613017 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4069db36a5de4906bdba8b9d2c86feb1', 'request_id': 'req-4bca01e7-a202-4eaf-b1f7-74970293bc88'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:08.624800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] The token cache is being invalidate because project 4069db36a5de4906bdba8b9d2c86feb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81550) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:51:08.653351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:08.653351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-4bca01e7-a202-4eaf-b1f7-74970293bc88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:08.653351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1444/2883] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:51:08 2022] DELETE /identity/v3/projects/4069db36a5de4906bdba8b9d2c86feb1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:08.653761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f6fde-4275-4d0e-9248-dcc9a4f0eb8e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:08.653761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f6fde-4275-4d0e-9248-dcc9a4f0eb8e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:08.653761 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f6fde-4275-4d0e-9248-dcc9a4f0eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:08.655217 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2c4f6fde-4275-4d0e-9248-dcc9a4f0eb8e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:08.656453 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2c4f6fde-4275-4d0e-9248-dcc9a4f0eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:08.709118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:08.726829 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1440/2884] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 22 14:51:08.736371 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06a661-a8f4-48b1-881b-58a0b3a80f8c None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:08.736957 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06a661-a8f4-48b1-881b-58a0b3a80f8c None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:08.737246 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06a661-a8f4-48b1-881b-58a0b3a80f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:08.758859 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-be06a661-a8f4-48b1-881b-58a0b3a80f8c None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:08.760813 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-be06a661-a8f4-48b1-881b-58a0b3a80f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:08.768758 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1445/2885] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:08.773292 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f6fde-4275-4d0e-9248-dcc9a4f0eb8e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:08.786888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f6fde-4275-4d0e-9248-dcc9a4f0eb8e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:08.794815 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:08.795849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:08.796341 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:08.796667 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:08.797917 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:51:08.798489 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:08.801647 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:08.824246 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1441/2886] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:51:08.828505 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06a661-a8f4-48b1-881b-58a0b3a80f8c None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:08.840437 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06a661-a8f4-48b1-881b-58a0b3a80f8c None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:08.845620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353264c-71f3-4779-ba02-3ebb54a5d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:08.846262 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353264c-71f3-4779-ba02-3ebb54a5d6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:08.846537 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353264c-71f3-4779-ba02-3ebb54a5d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:08.846809 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353264c-71f3-4779-ba02-3ebb54a5d6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:08.847466 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353264c-71f3-4779-ba02-3ebb54a5d6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:08.849367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353264c-71f3-4779-ba02-3ebb54a5d6f7 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:08.932297 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1446/2887] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:51:08 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:08.936628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:08.946863 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76979-7a36-463f-81ec-9e44d91c6abc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.009400 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cd023-e716-4db5-a810-9490e1aad2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.010528 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd023-e716-4db5-a810-9490e1aad2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.010826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd023-e716-4db5-a810-9490e1aad2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.011093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd023-e716-4db5-a810-9490e1aad2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.011730 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cd023-e716-4db5-a810-9490e1aad2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.013617 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cd023-e716-4db5-a810-9490e1aad2e8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.107996 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1442/2888] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:51:08 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:09.112529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353264c-71f3-4779-ba02-3ebb54a5d6f7 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:09.126482 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353264c-71f3-4779-ba02-3ebb54a5d6f7 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.132147 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91ba3-02bc-48fe-8ccb-e2c06b7e21e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.132763 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91ba3-02bc-48fe-8ccb-e2c06b7e21e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.133043 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91ba3-02bc-48fe-8ccb-e2c06b7e21e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.133326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91ba3-02bc-48fe-8ccb-e2c06b7e21e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.133958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff91ba3-02bc-48fe-8ccb-e2c06b7e21e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.139673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff91ba3-02bc-48fe-8ccb-e2c06b7e21e1 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.147564 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1447/2889] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:09.152899 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cd023-e716-4db5-a810-9490e1aad2e8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:09.164118 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cd023-e716-4db5-a810-9490e1aad2e8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.169455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120879fa-1f9e-4ef9-93a8-43b1aeac4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.170112 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120879fa-1f9e-4ef9-93a8-43b1aeac4c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.170396 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120879fa-1f9e-4ef9-93a8-43b1aeac4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.170660 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120879fa-1f9e-4ef9-93a8-43b1aeac4c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.171306 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120879fa-1f9e-4ef9-93a8-43b1aeac4c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.172888 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120879fa-1f9e-4ef9-93a8-43b1aeac4c88 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.185188 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1443/2890] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:09.189592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91ba3-02bc-48fe-8ccb-e2c06b7e21e1 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:09.200821 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91ba3-02bc-48fe-8ccb-e2c06b7e21e1 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.205675 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081e34c-1567-42cf-8b3b-63d66d7c71de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.206377 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081e34c-1567-42cf-8b3b-63d66d7c71de admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.206656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081e34c-1567-42cf-8b3b-63d66d7c71de admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.206925 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081e34c-1567-42cf-8b3b-63d66d7c71de admin admin] PATH_INFO: `/v3/projects/061e67f2ce20489aa1732812e0c90279/users/7ee95bd64e86444e9d91d14947fd4702/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.222740 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081e34c-1567-42cf-8b3b-63d66d7c71de admin admin] RBAC: Authorizing `identity:create_grant(project_id=061e67f2ce20489aa1732812e0c90279, user_id=7ee95bd64e86444e9d91d14947fd4702, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.231650 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081e34c-1567-42cf-8b3b-63d66d7c71de admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.319549 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1448/2891] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:51:09 2022] PUT /identity/v3/projects/061e67f2ce20489aa1732812e0c90279/users/7ee95bd64e86444e9d91d14947fd4702/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:09.332548 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f91a6-e248-4e51-94cb-7212f748ff66 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.332828 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f91a6-e248-4e51-94cb-7212f748ff66 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.333100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f91a6-e248-4e51-94cb-7212f748ff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.364458 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-078f91a6-e248-4e51-94cb-7212f748ff66 None None] MFA Rules not processed for user `7ee95bd64e86444e9d91d14947fd4702`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:09.365588 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-078f91a6-e248-4e51-94cb-7212f748ff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:09.441107 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1444/2892] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:09.446093 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081e34c-1567-42cf-8b3b-63d66d7c71de admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:09.456888 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:09.522004 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081e34c-1567-42cf-8b3b-63d66d7c71de admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.527293 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01397773-e2c6-47d1-871d-373b80829b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.529592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397773-e2c6-47d1-871d-373b80829b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.529592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397773-e2c6-47d1-871d-373b80829b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.529592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397773-e2c6-47d1-871d-373b80829b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.529592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01397773-e2c6-47d1-871d-373b80829b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.531168 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01397773-e2c6-47d1-871d-373b80829b23 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.614845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1449/2893] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:51:09 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:09.624535 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f91a6-e248-4e51-94cb-7212f748ff66 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:09.636918 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f91a6-e248-4e51-94cb-7212f748ff66 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.684546 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:09.700615 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b05c-d62e-441c-98f5-adc3c8f71aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.701628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b05c-d62e-441c-98f5-adc3c8f71aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.701628 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b05c-d62e-441c-98f5-adc3c8f71aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.701926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b05c-d62e-441c-98f5-adc3c8f71aeb admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.702498 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45b05c-d62e-441c-98f5-adc3c8f71aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.704446 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45b05c-d62e-441c-98f5-adc3c8f71aeb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.777338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1445/2894] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:51:09 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:09.781119 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01397773-e2c6-47d1-871d-373b80829b23 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:09.792485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01397773-e2c6-47d1-871d-373b80829b23 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.797163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8dec5-f365-4c20-9e34-bd3f720c3bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.797770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8dec5-f365-4c20-9e34-bd3f720c3bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.798078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8dec5-f365-4c20-9e34-bd3f720c3bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.798355 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8dec5-f365-4c20-9e34-bd3f720c3bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.799003 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8dec5-f365-4c20-9e34-bd3f720c3bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.800602 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8dec5-f365-4c20-9e34-bd3f720c3bb8 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.812815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1450/2895] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:09.816985 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b05c-d62e-441c-98f5-adc3c8f71aeb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:09.828964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b05c-d62e-441c-98f5-adc3c8f71aeb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.835589 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0594fc6-04b1-4154-b87d-8723bc0a7820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.836199 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0594fc6-04b1-4154-b87d-8723bc0a7820 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.836478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0594fc6-04b1-4154-b87d-8723bc0a7820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.836775 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0594fc6-04b1-4154-b87d-8723bc0a7820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.837415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0594fc6-04b1-4154-b87d-8723bc0a7820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.839153 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0594fc6-04b1-4154-b87d-8723bc0a7820 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.849964 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1446/2896] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:09.855471 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8dec5-f365-4c20-9e34-bd3f720c3bb8 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:09.866204 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8dec5-f365-4c20-9e34-bd3f720c3bb8 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:09.871797 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a510e-9237-46b9-9615-93c871fb57e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:09.872460 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a510e-9237-46b9-9615-93c871fb57e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.872734 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a510e-9237-46b9-9615-93c871fb57e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.873047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a510e-9237-46b9-9615-93c871fb57e4 admin admin] PATH_INFO: `/v3/projects/86579af043634ad3a1a69e5e9697babf/users/6a7a6dee364f4df6b3d21edb36aeff39/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:09.888968 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a510e-9237-46b9-9615-93c871fb57e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86579af043634ad3a1a69e5e9697babf, user_id=6a7a6dee364f4df6b3d21edb36aeff39, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:09.891620 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a510e-9237-46b9-9615-93c871fb57e4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:09.987681 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1451/2897] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:51:09 2022] PUT /identity/v3/projects/86579af043634ad3a1a69e5e9697babf/users/6a7a6dee364f4df6b3d21edb36aeff39/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:09.999313 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9d4e-8f17-474f-aa07-5932660fb5f5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:09.999593 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9d4e-8f17-474f-aa07-5932660fb5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:09.999872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9d4e-8f17-474f-aa07-5932660fb5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:10.030304 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6a2e9d4e-8f17-474f-aa07-5932660fb5f5 None None] MFA Rules not processed for user `6a7a6dee364f4df6b3d21edb36aeff39`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:10.031539 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6a2e9d4e-8f17-474f-aa07-5932660fb5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:10.101993 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1447/2898] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:10.107608 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a510e-9237-46b9-9615-93c871fb57e4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:10.172508 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a510e-9237-46b9-9615-93c871fb57e4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:10.177163 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198d5cc-fd37-44b5-89c0-cd6697ae3a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:10.177770 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198d5cc-fd37-44b5-89c0-cd6697ae3a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:10.178400 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198d5cc-fd37-44b5-89c0-cd6697ae3a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:10.178671 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198d5cc-fd37-44b5-89c0-cd6697ae3a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:10.179311 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198d5cc-fd37-44b5-89c0-cd6697ae3a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:10.181200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198d5cc-fd37-44b5-89c0-cd6697ae3a57 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:10.372864 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1452/2899] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:51:10 2022] POST /identity/v3/projects => generated 377 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:10.376925 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9d4e-8f17-474f-aa07-5932660fb5f5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:10.387662 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9d4e-8f17-474f-aa07-5932660fb5f5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:10.443882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69923341-d9b0-48f9-8789-45b9083cb0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:10.444398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69923341-d9b0-48f9-8789-45b9083cb0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:10.444677 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69923341-d9b0-48f9-8789-45b9083cb0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:10.444950 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69923341-d9b0-48f9-8789-45b9083cb0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:10.445584 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69923341-d9b0-48f9-8789-45b9083cb0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:10.447717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69923341-d9b0-48f9-8789-45b9083cb0ce admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:10.536537 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1448/2900] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:51:10 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:10.542656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198d5cc-fd37-44b5-89c0-cd6697ae3a57 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:10.551690 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198d5cc-fd37-44b5-89c0-cd6697ae3a57 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:10.557343 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ad0b-3855-4e29-a931-7fef79154fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:10.557945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ad0b-3855-4e29-a931-7fef79154fce admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:10.558258 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ad0b-3855-4e29-a931-7fef79154fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:10.558530 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ad0b-3855-4e29-a931-7fef79154fce admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:10.559181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849ad0b-3855-4e29-a931-7fef79154fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:10.560775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849ad0b-3855-4e29-a931-7fef79154fce admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:10.572654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1453/2901] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 22 14:51:10.576843 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69923341-d9b0-48f9-8789-45b9083cb0ce admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:10.587046 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69923341-d9b0-48f9-8789-45b9083cb0ce admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:10.592175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8208f7-3225-4b40-bbd0-3a4ce19de143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:10.592845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8208f7-3225-4b40-bbd0-3a4ce19de143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:10.593129 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8208f7-3225-4b40-bbd0-3a4ce19de143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:10.593406 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8208f7-3225-4b40-bbd0-3a4ce19de143 admin admin] PATH_INFO: `/v3/projects/acf260506c1b405f815592a263e84770/users/3fd30ff493514b719a57a4719952be6a/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:10.609392 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8208f7-3225-4b40-bbd0-3a4ce19de143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf260506c1b405f815592a263e84770, user_id=3fd30ff493514b719a57a4719952be6a, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:10.611892 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8208f7-3225-4b40-bbd0-3a4ce19de143 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:10.707587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1449/2902] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:51:10 2022] PUT /identity/v3/projects/acf260506c1b405f815592a263e84770/users/3fd30ff493514b719a57a4719952be6a/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:10.711656 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ad0b-3855-4e29-a931-7fef79154fce admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:10.724199 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ad0b-3855-4e29-a931-7fef79154fce admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:10.756391 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:10.784754 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b38a1-fad7-44e8-9f9b-80a07e72b44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:10.785367 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b38a1-fad7-44e8-9f9b-80a07e72b44f admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:10.785644 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b38a1-fad7-44e8-9f9b-80a07e72b44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:10.785917 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b38a1-fad7-44e8-9f9b-80a07e72b44f admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:10.786590 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b38a1-fad7-44e8-9f9b-80a07e72b44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:10.788176 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b38a1-fad7-44e8-9f9b-80a07e72b44f admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:10.799122 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1454/2903] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:10.803624 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8208f7-3225-4b40-bbd0-3a4ce19de143 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:10.814541 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8208f7-3225-4b40-bbd0-3a4ce19de143 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:10.819169 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:10.819808 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:10.820086 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:10.820356 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] PATH_INFO: `/v3/projects/acf260506c1b405f815592a263e84770/users/3fd30ff493514b719a57a4719952be6a/roles/f611d3669a1a4242b954f7626bfcbe75` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:10.822441 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf260506c1b405f815592a263e84770, user_id=3fd30ff493514b719a57a4719952be6a, role_id=f611d3669a1a4242b954f7626bfcbe75)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:10.825058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:10.835484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1450/2904] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:51:10 2022] PUT /identity/v3/projects/acf260506c1b405f815592a263e84770/users/3fd30ff493514b719a57a4719952be6a/roles/f611d3669a1a4242b954f7626bfcbe75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:10.846438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfce82-c6cc-4882-acea-06e9b656d82a None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:10.846720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfce82-c6cc-4882-acea-06e9b656d82a None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:10.846989 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfce82-c6cc-4882-acea-06e9b656d82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:10.874684 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-e4dfce82-c6cc-4882-acea-06e9b656d82a None None] MFA Rules not processed for user `3fd30ff493514b719a57a4719952be6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:10.875892 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e4dfce82-c6cc-4882-acea-06e9b656d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:10.942200 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1455/2905] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:10.953622 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:10.955383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:10.962106 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:11.014686 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bb151-2f7d-483c-917c-36665818651f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:11.018365 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e54bf-3937-47a8-b9e9-cdc3d6622c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:11.018971 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e54bf-3937-47a8-b9e9-cdc3d6622c3a service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:11.019247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e54bf-3937-47a8-b9e9-cdc3d6622c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:11.019516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e54bf-3937-47a8-b9e9-cdc3d6622c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:11.078073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e54bf-3937-47a8-b9e9-cdc3d6622c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:11.079506 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e54bf-3937-47a8-b9e9-cdc3d6622c3a service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:11.089383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1451/2906] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:13.021465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfce82-c6cc-4882-acea-06e9b656d82a None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:13.022963 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-e4dfce82-c6cc-4882-acea-06e9b656d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:13.035815 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfce82-c6cc-4882-acea-06e9b656d82a None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:13.039607 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f368-ff7b-4769-8db5-761ff0a8968c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:13.040210 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f368-ff7b-4769-8db5-761ff0a8968c service cinder] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:13.040517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f368-ff7b-4769-8db5-761ff0a8968c service cinder] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:13.041326 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f368-ff7b-4769-8db5-761ff0a8968c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:13.100416 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86f368-ff7b-4769-8db5-761ff0a8968c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:13.101856 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86f368-ff7b-4769-8db5-761ff0a8968c service cinder] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:13.111727 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1456/2907] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:14.571559 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e54bf-3937-47a8-b9e9-cdc3d6622c3a service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:14.580353 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e54bf-3937-47a8-b9e9-cdc3d6622c3a service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:14.583992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1ea23-9ad0-4500-ab46-175bc08efbb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:14.584608 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ea23-9ad0-4500-ab46-175bc08efbb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:14.584882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ea23-9ad0-4500-ab46-175bc08efbb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:14.585151 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ea23-9ad0-4500-ab46-175bc08efbb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:14.594785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1ea23-9ad0-4500-ab46-175bc08efbb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:14.596182 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1ea23-9ad0-4500-ab46-175bc08efbb4 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:14.606356 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1452/2908] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:19.235735 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f368-ff7b-4769-8db5-761ff0a8968c service cinder] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:19.286984 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=100 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:19.299845 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f368-ff7b-4769-8db5-761ff0a8968c service cinder] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:19.304791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:19.305465 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:19.307393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:19.307393 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] PATH_INFO: `/v3/users/7ee95bd64e86444e9d91d14947fd4702` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:19.307817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee95bd64e86444e9d91d14947fd4702)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:19.309726 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:19.481988 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee95bd64e86444e9d91d14947fd4702'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:19.482723 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee95bd64e86444e9d91d14947fd4702'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:19.489807 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee95bd64e86444e9d91d14947fd4702'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:19.503220 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee95bd64e86444e9d91d14947fd4702'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:19.503879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee95bd64e86444e9d91d14947fd4702'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:19.569791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1457/2909] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:51:19 2022] DELETE /identity/v3/users/7ee95bd64e86444e9d91d14947fd4702 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:19.574717 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e79cf4-246c-448e-9cf7-476630bc3164 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:19.579736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e79cf4-246c-448e-9cf7-476630bc3164 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:19.579736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e79cf4-246c-448e-9cf7-476630bc3164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:19.596826 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-71e79cf4-246c-448e-9cf7-476630bc3164 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:19.598157 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-71e79cf4-246c-448e-9cf7-476630bc3164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:19.662513 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1453/2910] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:19.673395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:19.674905 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:19.738844 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aac98-343d-44b0-97fb-825f5e2e05bd admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:19.742451 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de1c6a-08b6-4e53-afa1-c4e8976a374e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:19.743064 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1c6a-08b6-4e53-afa1-c4e8976a374e service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:19.743348 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1c6a-08b6-4e53-afa1-c4e8976a374e service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:19.743646 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1c6a-08b6-4e53-afa1-c4e8976a374e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:19.753789 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de1c6a-08b6-4e53-afa1-c4e8976a374e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:19.755303 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de1c6a-08b6-4e53-afa1-c4e8976a374e service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:19.766106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1458/2911] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:20.160181 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e79cf4-246c-448e-9cf7-476630bc3164 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:20.161713 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-71e79cf4-246c-448e-9cf7-476630bc3164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:20.175739 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e79cf4-246c-448e-9cf7-476630bc3164 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:20.180845 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:20.181555 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:20.181937 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:20.182247 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] PATH_INFO: `/v3/projects/061e67f2ce20489aa1732812e0c90279` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:20.183402 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061e67f2ce20489aa1732812e0c90279)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:20.185308 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:20.280316 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:20.286405 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061e67f2ce20489aa1732812e0c90279', 'request_id': 'req-fb329a27-aa88-4d06-9122-d444d1ecd915'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.352478 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061e67f2ce20489aa1732812e0c90279', 'request_id': 'req-fb329a27-aa88-4d06-9122-d444d1ecd915'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.358978 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061e67f2ce20489aa1732812e0c90279', 'request_id': 'req-fb329a27-aa88-4d06-9122-d444d1ecd915'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.371472 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] The token cache is being invalidate because project 061e67f2ce20489aa1732812e0c90279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:51:20.371812 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.372397 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.373906 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1454/2912] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:51:20 2022] DELETE /identity/v3/projects/061e67f2ce20489aa1732812e0c90279 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:20.377958 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de1c6a-08b6-4e53-afa1-c4e8976a374e service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:20.389132 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de1c6a-08b6-4e53-afa1-c4e8976a374e service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:20.448408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:20.449092 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:20.449370 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:20.449640 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] PATH_INFO: `/v3/users/6a7a6dee364f4df6b3d21edb36aeff39` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:20.450897 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7a6dee364f4df6b3d21edb36aeff39)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:20.452801 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:20.467389 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:20.630453 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7a6dee364f4df6b3d21edb36aeff39'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.631146 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7a6dee364f4df6b3d21edb36aeff39'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.639351 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7a6dee364f4df6b3d21edb36aeff39'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.651422 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7a6dee364f4df6b3d21edb36aeff39'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.652106 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7a6dee364f4df6b3d21edb36aeff39'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:20.701273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1459/2913] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:51:20 2022] DELETE /identity/v3/users/6a7a6dee364f4df6b3d21edb36aeff39 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 22 14:51:21.118218 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:21.120245 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:21.133211 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329a27-aa88-4d06-9122-d444d1ecd915 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:21.199819 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:21.200455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:21.200736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:21.201011 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] PATH_INFO: `/v3/projects/86579af043634ad3a1a69e5e9697babf` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:21.202178 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86579af043634ad3a1a69e5e9697babf)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:21.204073 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:21.342425 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86579af043634ad3a1a69e5e9697babf', 'request_id': 'req-4e68d720-03e3-4b2d-8a91-341bdab9c952'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.460994 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86579af043634ad3a1a69e5e9697babf', 'request_id': 'req-4e68d720-03e3-4b2d-8a91-341bdab9c952'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.467187 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86579af043634ad3a1a69e5e9697babf', 'request_id': 'req-4e68d720-03e3-4b2d-8a91-341bdab9c952'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.478887 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] The token cache is being invalidate because project 86579af043634ad3a1a69e5e9697babf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:51:21.479280 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.480145 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.481853 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1455/2914] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:51:21 2022] DELETE /identity/v3/projects/86579af043634ad3a1a69e5e9697babf => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:21.485936 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:21.487415 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:21.500800 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a2933-9a45-463e-9ade-0c9d91565dfb admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:21.559952 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:21.560600 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:21.560883 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:21.561180 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] PATH_INFO: `/v3/users/3fd30ff493514b719a57a4719952be6a` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:21.562359 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd30ff493514b719a57a4719952be6a)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:21.564332 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:21.749181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd30ff493514b719a57a4719952be6a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.749839 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd30ff493514b719a57a4719952be6a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.756979 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd30ff493514b719a57a4719952be6a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.769306 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd30ff493514b719a57a4719952be6a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.770052 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-773df73c-5f68-414b-8e0b-dc38987dfdd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd30ff493514b719a57a4719952be6a'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:21.844485 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1460/2915] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:51:21 2022] DELETE /identity/v3/users/3fd30ff493514b719a57a4719952be6a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:22.314757 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:22.315786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:22.330872 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68d720-03e3-4b2d-8a91-341bdab9c952 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:22.393618 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:22.394277 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:22.394561 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:22.394836 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] PATH_INFO: `/v3/projects/acf260506c1b405f815592a263e84770` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:22.395976 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf260506c1b405f815592a263e84770)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:22.397910 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:22.399469 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:22.514083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf260506c1b405f815592a263e84770', 'request_id': 'req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:22.615299 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf260506c1b405f815592a263e84770', 'request_id': 'req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:22.621484 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf260506c1b405f815592a263e84770', 'request_id': 'req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:22.635904 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] The token cache is being invalidate because project acf260506c1b405f815592a263e84770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:51:22.636200 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:22.636875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b9bf440c-cead-4a41-8b9e-c2cbbce262f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:22.638418 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1456/2916] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:51:22 2022] DELETE /identity/v3/projects/acf260506c1b405f815592a263e84770 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:22.643456 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779ca5e-92ef-4c10-b648-6af665c4d861 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:22.644057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779ca5e-92ef-4c10-b648-6af665c4d861 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:22.644057 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779ca5e-92ef-4c10-b648-6af665c4d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:22.666113 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-1779ca5e-92ef-4c10-b648-6af665c4d861 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:22.667414 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-1779ca5e-92ef-4c10-b648-6af665c4d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:22.672923 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:22.736944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1461/2917] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:22.746942 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a062fe-1990-4fde-8a77-cea71d2a376e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:22.747415 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a062fe-1990-4fde-8a77-cea71d2a376e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:22.747898 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a062fe-1990-4fde-8a77-cea71d2a376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:22.770362 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-21a062fe-1990-4fde-8a77-cea71d2a376e None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:22.771689 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-21a062fe-1990-4fde-8a77-cea71d2a376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:22.780640 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1457/2918] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:22.784571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779ca5e-92ef-4c10-b648-6af665c4d861 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:22.795330 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779ca5e-92ef-4c10-b648-6af665c4d861 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:22.800000 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:22.800604 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:22.800879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:22.801170 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:22.801818 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:51:22.802175 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:22.804038 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:22.817047 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1462/2919] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:51:22.821522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a062fe-1990-4fde-8a77-cea71d2a376e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:22.832291 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a062fe-1990-4fde-8a77-cea71d2a376e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:22.837734 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a7070-0f0a-42b7-982a-5adb8b850b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:22.838516 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7070-0f0a-42b7-982a-5adb8b850b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:22.838797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7070-0f0a-42b7-982a-5adb8b850b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:22.839072 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7070-0f0a-42b7-982a-5adb8b850b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:22.839755 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a7070-0f0a-42b7-982a-5adb8b850b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:22.841719 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a7070-0f0a-42b7-982a-5adb8b850b37 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:22.955926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1458/2920] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:51:22 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:22.960154 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:22.971067 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d934-58eb-45d8-ae93-ec396c9b8516 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:23.032339 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fbc64-f6a5-4003-8299-bf76187a4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:23.032973 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fbc64-f6a5-4003-8299-bf76187a4744 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:23.033260 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fbc64-f6a5-4003-8299-bf76187a4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:23.033525 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fbc64-f6a5-4003-8299-bf76187a4744 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:23.034181 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fbc64-f6a5-4003-8299-bf76187a4744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:23.036068 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fbc64-f6a5-4003-8299-bf76187a4744 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:23.112826 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1463/2921] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:51:22 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:23.116995 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a7070-0f0a-42b7-982a-5adb8b850b37 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:23.128727 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a7070-0f0a-42b7-982a-5adb8b850b37 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:23.133475 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc516-9252-4a76-ac9d-b2b99b8b20c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:23.134140 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc516-9252-4a76-ac9d-b2b99b8b20c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:23.134421 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc516-9252-4a76-ac9d-b2b99b8b20c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:23.134701 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc516-9252-4a76-ac9d-b2b99b8b20c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:23.135338 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bc516-9252-4a76-ac9d-b2b99b8b20c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:23.136926 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bc516-9252-4a76-ac9d-b2b99b8b20c0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:23.147612 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1459/2922] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:23.152930 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fbc64-f6a5-4003-8299-bf76187a4744 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:23.163063 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fbc64-f6a5-4003-8299-bf76187a4744 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:23.168787 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93704c-c7b3-44c0-967d-f4cca3a45c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:23.169395 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93704c-c7b3-44c0-967d-f4cca3a45c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:23.169673 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93704c-c7b3-44c0-967d-f4cca3a45c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:23.169945 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93704c-c7b3-44c0-967d-f4cca3a45c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:23.170631 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93704c-c7b3-44c0-967d-f4cca3a45c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:23.172231 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93704c-c7b3-44c0-967d-f4cca3a45c63 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:23.184344 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1464/2923] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:23.188813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc516-9252-4a76-ac9d-b2b99b8b20c0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:23.199116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc516-9252-4a76-ac9d-b2b99b8b20c0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:23.203803 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:23.204455 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:23.204736 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:23.205009 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] PATH_INFO: `/v3/projects/c78db4cf29824975ac3b039cf477afd5/users/a85d333e76d744b1ae3e318afe65356b/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:23.220401 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78db4cf29824975ac3b039cf477afd5, user_id=a85d333e76d744b1ae3e318afe65356b, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:23.223052 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:23.291786 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1460/2924] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:51:23 2022] PUT /identity/v3/projects/c78db4cf29824975ac3b039cf477afd5/users/a85d333e76d744b1ae3e318afe65356b/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:23.302368 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2c47-632a-4f03-b1e3-46194f15ed09 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:23.302904 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2c47-632a-4f03-b1e3-46194f15ed09 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:23.303177 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2c47-632a-4f03-b1e3-46194f15ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:23.331345 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7b0d2c47-632a-4f03-b1e3-46194f15ed09 None None] MFA Rules not processed for user `a85d333e76d744b1ae3e318afe65356b`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:23.332592 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7b0d2c47-632a-4f03-b1e3-46194f15ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:23.397479 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1465/2925] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:23.409320 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:23.411061 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:23.470504 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b77604-cad8-4312-b0ab-094a8b07549d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:23.474100 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d9634-6553-4724-83b5-d9e1501307fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:23.474709 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9634-6553-4724-83b5-d9e1501307fd service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:23.474992 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9634-6553-4724-83b5-d9e1501307fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:23.475269 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d9634-6553-4724-83b5-d9e1501307fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:23.484743 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d9634-6553-4724-83b5-d9e1501307fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:23.486179 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d9634-6553-4724-83b5-d9e1501307fd service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:23.495094 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1461/2926] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 22 14:51:33.394375 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:33.490960 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:35.049408 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2c47-632a-4f03-b1e3-46194f15ed09 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:35.113442 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2c47-632a-4f03-b1e3-46194f15ed09 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:35.118365 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:35.118995 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:35.119267 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:35.119535 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] PATH_INFO: `/v3/users/a85d333e76d744b1ae3e318afe65356b` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:35.120654 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85d333e76d744b1ae3e318afe65356b)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:35.122585 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:35.298046 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85d333e76d744b1ae3e318afe65356b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:35.298775 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85d333e76d744b1ae3e318afe65356b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:35.307250 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85d333e76d744b1ae3e318afe65356b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:35.321944 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85d333e76d744b1ae3e318afe65356b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:35.323179 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85d333e76d744b1ae3e318afe65356b'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:35.392455 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1466/2927] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:51:35 2022] DELETE /identity/v3/users/a85d333e76d744b1ae3e318afe65356b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:35.397093 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0ebf-3696-4e8c-a778-10976ea3af40 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:35.397587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0ebf-3696-4e8c-a778-10976ea3af40 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:35.397771 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0ebf-3696-4e8c-a778-10976ea3af40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:35.418690 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-264c0ebf-3696-4e8c-a778-10976ea3af40 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:35.419919 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-264c0ebf-3696-4e8c-a778-10976ea3af40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:35.480811 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1462/2928] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:35.490753 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:35.494208 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:35.551529 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40be2-3bcc-432b-bbcb-45724926dbdd admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:35.556328 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993aeb7-26b3-49d2-bb0e-c2393a7e5073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:35.556954 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993aeb7-26b3-49d2-bb0e-c2393a7e5073 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:35.557292 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993aeb7-26b3-49d2-bb0e-c2393a7e5073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:35.557571 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993aeb7-26b3-49d2-bb0e-c2393a7e5073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:35.567720 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993aeb7-26b3-49d2-bb0e-c2393a7e5073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:35.569169 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993aeb7-26b3-49d2-bb0e-c2393a7e5073 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:35.582290 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1467/2929] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:35.965336 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0ebf-3696-4e8c-a778-10976ea3af40 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:35.967651 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-264c0ebf-3696-4e8c-a778-10976ea3af40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:35.980793 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0ebf-3696-4e8c-a778-10976ea3af40 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:35.985712 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:35.986398 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:35.986685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:35.986962 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] PATH_INFO: `/v3/projects/c78db4cf29824975ac3b039cf477afd5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:35.988116 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78db4cf29824975ac3b039cf477afd5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:35.991563 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:36.108669 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78db4cf29824975ac3b039cf477afd5', 'request_id': 'req-bd728d9f-a8ac-45ca-8d05-ee390b059166'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:36.181444 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78db4cf29824975ac3b039cf477afd5', 'request_id': 'req-bd728d9f-a8ac-45ca-8d05-ee390b059166'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:36.187870 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78db4cf29824975ac3b039cf477afd5', 'request_id': 'req-bd728d9f-a8ac-45ca-8d05-ee390b059166'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:36.199890 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] The token cache is being invalidate because project c78db4cf29824975ac3b039cf477afd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:51:36.200175 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:36.200820 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-bd728d9f-a8ac-45ca-8d05-ee390b059166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:36.202491 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1463/2930] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:51:35 2022] DELETE /identity/v3/projects/c78db4cf29824975ac3b039cf477afd5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:36.207510 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1bd8-0628-49ec-9e64-74eea19be986 None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.208018 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1bd8-0628-49ec-9e64-74eea19be986 None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.208130 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a1bd8-0628-49ec-9e64-74eea19be986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.227830 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-6d8a1bd8-0628-49ec-9e64-74eea19be986 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:36.229616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-6d8a1bd8-0628-49ec-9e64-74eea19be986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:36.248008 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:36.289817 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1468/2931] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:36.297779 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fe953-e71d-4989-8267-278f6601ba28 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.298110 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fe953-e71d-4989-8267-278f6601ba28 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.298381 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fe953-e71d-4989-8267-278f6601ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.320941 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3b5fe953-e71d-4989-8267-278f6601ba28 None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:36.322825 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3b5fe953-e71d-4989-8267-278f6601ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:36.330807 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1464/2932] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:36.335436 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1bd8-0628-49ec-9e64-74eea19be986 None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:36.345401 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a1bd8-0628-49ec-9e64-74eea19be986 None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:36.350078 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:36.357161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.357161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.357161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] PATH_INFO: `/v3/domains` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.357161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 22 14:51:36.357161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:36.357161 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:36.365379 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1469/2933] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 22 14:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 22 14:51:36.370466 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fe953-e71d-4989-8267-278f6601ba28 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:36.380149 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fe953-e71d-4989-8267-278f6601ba28 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:36.386205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26017458-a414-4699-8e3d-cf4df4ca2307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:36.386785 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26017458-a414-4699-8e3d-cf4df4ca2307 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.387058 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26017458-a414-4699-8e3d-cf4df4ca2307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.387326 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26017458-a414-4699-8e3d-cf4df4ca2307 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.387953 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26017458-a414-4699-8e3d-cf4df4ca2307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:36.389831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26017458-a414-4699-8e3d-cf4df4ca2307 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:36.450980 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1465/2934] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 22 14:51:36 2022] POST /identity/v3/projects => generated 399 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:36.455425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:36.465695 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5359-f690-46de-8db6-b8963aacd7df admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:36.522616 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1b84-72a8-4558-b5ca-d27263d221b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:36.523236 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1b84-72a8-4558-b5ca-d27263d221b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.523517 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1b84-72a8-4558-b5ca-d27263d221b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.523791 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1b84-72a8-4558-b5ca-d27263d221b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.524488 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1b84-72a8-4558-b5ca-d27263d221b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:36.526432 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1b84-72a8-4558-b5ca-d27263d221b4 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:36.639896 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1470/2935] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 22 14:51:36 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 22 14:51:36.644126 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26017458-a414-4699-8e3d-cf4df4ca2307 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:36.655202 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26017458-a414-4699-8e3d-cf4df4ca2307 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:36.660242 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1a58-377a-48e8-a4f4-962607808204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:36.661127 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1a58-377a-48e8-a4f4-962607808204 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.661407 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1a58-377a-48e8-a4f4-962607808204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.661687 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1a58-377a-48e8-a4f4-962607808204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.662363 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c1a58-377a-48e8-a4f4-962607808204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:36.663949 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c1a58-377a-48e8-a4f4-962607808204 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:36.675835 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1466/2936] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:36.681320 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1b84-72a8-4558-b5ca-d27263d221b4 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:36.691647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1b84-72a8-4558-b5ca-d27263d221b4 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:36.696586 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfff38d-4ea0-4457-a386-018aa7a66443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:36.697186 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfff38d-4ea0-4457-a386-018aa7a66443 admin admin] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.697462 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfff38d-4ea0-4457-a386-018aa7a66443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.697739 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfff38d-4ea0-4457-a386-018aa7a66443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.698425 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfff38d-4ea0-4457-a386-018aa7a66443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:36.700025 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfff38d-4ea0-4457-a386-018aa7a66443 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:36.712806 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1471/2937] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 22 14:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 22 14:51:36.718831 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1a58-377a-48e8-a4f4-962607808204 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:36.730205 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1a58-377a-48e8-a4f4-962607808204 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:36.734983 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:36.735656 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.735935 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.737076 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] PATH_INFO: `/v3/projects/5e0d9b1c61e44c1695cc272d5ea32729/users/de4ba00c9d4e47c5a19a2c51a5304588/roles/2be9f83593d64e6ea6877bccf0dda44c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.754239 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0d9b1c61e44c1695cc272d5ea32729, user_id=de4ba00c9d4e47c5a19a2c51a5304588, role_id=2be9f83593d64e6ea6877bccf0dda44c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:36.756882 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:36.849600 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1467/2938] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 22 14:51:36 2022] PUT /identity/v3/projects/5e0d9b1c61e44c1695cc272d5ea32729/users/de4ba00c9d4e47c5a19a2c51a5304588/roles/2be9f83593d64e6ea6877bccf0dda44c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:36.861178 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e91b5-f34d-4aa4-a289-459ea039cb3e None None] REQUEST_METHOD: `POST` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:36.861459 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e91b5-f34d-4aa4-a289-459ea039cb3e None None] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:36.861752 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e91b5-f34d-4aa4-a289-459ea039cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:36.890440 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.auth.core [None req-7a0e91b5-f34d-4aa4-a289-459ea039cb3e None None] MFA Rules not processed for user `de4ba00c9d4e47c5a19a2c51a5304588`. Rule list: `[]` (Enabled: `True`). {{(pid=81550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:36.891588 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-7a0e91b5-f34d-4aa4-a289-459ea039cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:36.958418 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1472/2939] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:36.970383 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:36.972083 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:36.994545 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:37.029685 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fe4fe-24bf-45ee-95e7-bd4fcac556c8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:37.033389 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02ecba-4fc3-47b6-b5c0-48f9595483f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58f40fbc281849418ef9d4c75562c56a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:37.035724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ecba-4fc3-47b6-b5c0-48f9595483f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:37.035724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ecba-4fc3-47b6-b5c0-48f9595483f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:37.035724 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ecba-4fc3-47b6-b5c0-48f9595483f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:37.043522 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02ecba-4fc3-47b6-b5c0-48f9595483f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:37.044946 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02ecba-4fc3-47b6-b5c0-48f9595483f9 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:37.054805 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1468/2940] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:42.867162 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e91b5-f34d-4aa4-a289-459ea039cb3e None None] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:42.887647 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:42.936167 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e91b5-f34d-4aa4-a289-459ea039cb3e None None] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:42.941385 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:42.942040 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:42.942438 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:42.942716 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] PATH_INFO: `/v3/users/de4ba00c9d4e47c5a19a2c51a5304588` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:42.943853 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4ba00c9d4e47c5a19a2c51a5304588)` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:42.945811 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:43.138661 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4ba00c9d4e47c5a19a2c51a5304588'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:43.139309 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4ba00c9d4e47c5a19a2c51a5304588'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:43.147349 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4ba00c9d4e47c5a19a2c51a5304588'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:43.161427 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4ba00c9d4e47c5a19a2c51a5304588'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:43.162248 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.notifications [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4ba00c9d4e47c5a19a2c51a5304588'} {{(pid=81550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:43.238128 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1473/2941] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 22 14:51:42 2022] DELETE /identity/v3/users/de4ba00c9d4e47c5a19a2c51a5304588 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:43.243384 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fe24-b93e-4059-b24a-15a711453fdb None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:43.244213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fe24-b93e-4059-b24a-15a711453fdb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:43.244213 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8fe24-b93e-4059-b24a-15a711453fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:43.264797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b5b8fe24-b93e-4059-b24a-15a711453fdb None None] MFA Rules not processed for user `83e7a3ec09bb47549d2dc9a48d9658cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 22 14:51:43.266098 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b5b8fe24-b93e-4059-b24a-15a711453fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:43.327865 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1469/2942] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 22 14:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 22 14:51:43.339232 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:43.340741 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:43.399394 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecf944-1682-4761-9b1e-e549b93b23f9 admin admin] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:43.402985 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75252b7cba4943b2874983d1a83a9175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:43.403594 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:43.403879 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:43.404148 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:43.413518 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:43.415557 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:43.425296 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1474/2943] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:51:43.788862 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8fe24-b93e-4059-b24a-15a711453fdb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:51:43.791587 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b5b8fe24-b93e-4059-b24a-15a711453fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:51:43.804195 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8fe24-b93e-4059-b24a-15a711453fdb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:51:43.809499 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83e7a3ec09bb47549d2dc9a48d9658cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3670bb30aaf4bc3a00e3f65e0110ae7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:51:43.810168 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:51:43.810445 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:51:43.810716 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] PATH_INFO: `/v3/projects/5e0d9b1c61e44c1695cc272d5ea32729` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:51:43.811875 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0d9b1c61e44c1695cc272d5ea32729)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:51:43.813813 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:51:43.952797 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0d9b1c61e44c1695cc272d5ea32729', 'request_id': 'req-8b171d42-c86f-4bfe-a778-af8d9e4024f2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:44.031885 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0d9b1c61e44c1695cc272d5ea32729', 'request_id': 'req-8b171d42-c86f-4bfe-a778-af8d9e4024f2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:44.038394 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0d9b1c61e44c1695cc272d5ea32729', 'request_id': 'req-8b171d42-c86f-4bfe-a778-af8d9e4024f2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:44.049849 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] The token cache is being invalidate because project 5e0d9b1c61e44c1695cc272d5ea32729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 22 14:51:44.050163 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:44.050792 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b171d42-c86f-4bfe-a778-af8d9e4024f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 22 14:51:44.052523 dv-cinder-855359-4-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1470/2944] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 22 14:51:43 2022] DELETE /identity/v3/projects/5e0d9b1c61e44c1695cc272d5ea32729 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 22 14:51:53.420778 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:51:54.046928 dv-cinder-855359-4-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 14:53:59.339215 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] Authenticating user token {{(pid=81550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 22 14:53:59.341275 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:53:59.411746 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d863c7-21a1-4cff-8ccc-17e728c9bb44 service neutron] Validating token access rules against request {{(pid=81550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 22 14:53:59.473962 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccb11f-4193-48d8-bd5f-7cd8d1f01ece service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47cdb10124184914a81a87ae3173b8a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a284deafef4655839c517e7eee7ff6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 22 14:53:59.474603 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb11f-4193-48d8-bd5f-7cd8d1f01ece service placement] REQUEST_METHOD: `GET` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 22 14:53:59.474884 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb11f-4193-48d8-bd5f-7cd8d1f01ece service placement] SCRIPT_NAME: `/identity` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 22 14:53:59.475156 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccb11f-4193-48d8-bd5f-7cd8d1f01ece service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 22 14:53:59.477015 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.fernet_utils [None req-21ccb11f-4193-48d8-bd5f-7cd8d1f01ece service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 22 14:53:59.489076 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccb11f-4193-48d8-bd5f-7cd8d1f01ece service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 22 14:53:59.490731 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccb11f-4193-48d8-bd5f-7cd8d1f01ece service placement] RBAC: Authorization granted {{(pid=81550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 22 14:53:59.501938 dv-cinder-855359-4-smb devstack@keystone.service[81550]: [pid: 81550|app: 0|req: 1475/2945] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 22 14:53:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 22 14:54:09.497273 dv-cinder-855359-4-smb devstack@keystone.service[81550]: DEBUG dbcounter [-] [81550] Writing DB stats keystone:SELECT=58 {{(pid=81550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}